Jul 08 15:55:47.594346 ip-10-0-128-249 systemd[1]: Starting Kubernetes Kubelet... Jul 08 15:55:48.057839 ip-10-0-128-249 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:55:48.057839 ip-10-0-128-249 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 15:55:48.057839 ip-10-0-128-249 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:55:48.057839 ip-10-0-128-249 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 15:55:48.057839 ip-10-0-128-249 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 15:55:48.059469 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.059374 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 15:55:48.064511 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064483 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.064511 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064511 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.064511 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064516 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.064511 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064520 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064524 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064528 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064531 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064534 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064537 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064540 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064543 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064545 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064548 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064551 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064554 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064557 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064574 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064577 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064580 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064583 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064586 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064589 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064591 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.064641 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064594 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064597 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064600 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064603 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064605 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064608 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064611 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064613 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064617 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064620 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064622 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064626 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064631 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064634 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064640 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064643 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064646 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064650 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064653 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064657 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.065167 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064660 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064663 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064666 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064669 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064671 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064674 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064684 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064687 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064690 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064693 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064695 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064698 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064701 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064704 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064707 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064709 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064712 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064715 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064722 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.065705 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064726 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064729 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064732 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064736 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064739 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064742 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064745 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064750 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064754 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064757 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064760 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064763 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064766 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064769 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064772 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064775 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064778 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064781 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064784 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.066248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064787 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064790 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064793 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064796 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064799 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064801 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064804 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064807 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064810 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064812 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064815 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064818 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064821 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064824 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064827 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064830 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064832 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.066761 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.064835 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.067707 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067693 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.067707 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067706 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067710 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067714 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067717 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067721 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067724 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067726 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067729 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067732 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067735 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067738 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067741 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067744 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067746 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067749 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067753 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067755 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067758 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067761 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067764 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067767 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.067764 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067770 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067773 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067776 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067780 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067783 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067785 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067788 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067791 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067794 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067796 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067799 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067802 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067805 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067807 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067810 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067814 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067816 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067819 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067822 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067824 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.068360 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067827 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067831 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067833 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067836 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067839 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067841 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067844 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067847 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067850 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067853 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067857 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067861 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067864 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067867 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067871 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067874 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067878 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067881 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067883 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.068887 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067886 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067891 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067895 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067898 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067903 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067907 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067909 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067912 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067915 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067918 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067921 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067923 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067926 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067929 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067932 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067935 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067938 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067940 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067943 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067945 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.069408 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067949 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067952 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067955 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067958 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067961 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067963 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067968 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067972 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067975 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067978 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067981 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067983 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067986 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067989 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067991 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067995 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.067997 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068001 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.069939 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068489 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068495 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068499 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068502 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068505 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068509 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068511 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068514 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068517 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068520 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068523 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068526 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068528 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068531 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068534 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068537 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068540 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068543 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068546 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068554 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.070442 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068557 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068560 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068563 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068567 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068569 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068572 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068576 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068579 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068581 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068585 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068587 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068590 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068594 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068596 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068599 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068602 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068604 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068607 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068610 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.070979 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068613 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068616 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068619 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068622 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068627 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068631 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068634 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068636 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068640 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068643 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068646 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068649 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068653 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068656 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068659 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068662 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068665 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068668 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068671 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.071500 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068673 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068676 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068678 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068682 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068685 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068688 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068691 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068694 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068696 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068699 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068702 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068705 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068708 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068711 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068713 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068716 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068719 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068724 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068728 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068731 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.072007 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068734 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068737 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068740 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068743 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068746 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068750 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068753 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068756 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068758 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068761 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068764 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068767 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068769 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068773 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068775 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068778 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068781 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068784 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068786 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.072590 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068789 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.068793 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068863 2558 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068871 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068877 2558 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068882 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068886 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068890 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068894 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068899 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068903 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068906 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068910 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068914 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068917 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068921 2558 flags.go:64] FLAG: --cgroup-root="" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068924 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068928 2558 flags.go:64] FLAG: --client-ca-file="" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068932 2558 flags.go:64] FLAG: --cloud-provider="external" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068935 2558 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068940 2558 flags.go:64] FLAG: --cluster-domain="" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068944 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068947 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 15:55:48.073099 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068951 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068954 2558 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068958 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068962 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068965 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068969 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068972 2558 flags.go:64] FLAG: --contention-profiling="false" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068975 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068978 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068982 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068985 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068990 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068993 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068996 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.068999 2558 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069002 2558 flags.go:64] FLAG: --enable-server="true" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069006 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069010 2558 flags.go:64] FLAG: --event-burst="100" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069013 2558 flags.go:64] FLAG: --event-qps="50" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069016 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069020 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069023 2558 flags.go:64] FLAG: --eviction-hard="" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069027 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069031 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069034 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 15:55:48.073761 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069037 2558 flags.go:64] FLAG: --eviction-soft="" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069040 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069044 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069048 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069052 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069054 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069058 2558 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069061 2558 flags.go:64] FLAG: --feature-gates="" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069065 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069069 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069072 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069075 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069078 2558 flags.go:64] FLAG: --healthz-port="10248" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069082 2558 flags.go:64] FLAG: --help="false" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069085 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069088 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069092 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069095 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069098 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069102 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069105 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069108 2558 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069111 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 15:55:48.074460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069114 2558 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069117 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069121 2558 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069124 2558 flags.go:64] FLAG: --kube-reserved="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069127 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069130 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069133 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069138 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069141 2558 flags.go:64] FLAG: --lock-file="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069144 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069148 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069152 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069174 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069178 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069182 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069185 2558 flags.go:64] FLAG: --logging-format="text" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069188 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069192 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069195 2558 flags.go:64] FLAG: --manifest-url="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069198 2558 flags.go:64] FLAG: --manifest-url-header="" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069203 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069206 2558 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069210 2558 flags.go:64] FLAG: --max-pods="110" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069214 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069217 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 15:55:48.075091 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069220 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069223 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069227 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069230 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069233 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069241 2558 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069245 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069248 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069251 2558 flags.go:64] FLAG: --pod-cidr="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069254 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069260 2558 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069263 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069267 2558 flags.go:64] FLAG: --pods-per-core="0" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069269 2558 flags.go:64] FLAG: --port="10250" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069274 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069277 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eda621467817a69c" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069281 2558 flags.go:64] FLAG: --qos-reserved="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069284 2558 flags.go:64] FLAG: --read-only-port="10255" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069287 2558 flags.go:64] FLAG: --register-node="true" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069291 2558 flags.go:64] FLAG: --register-with-taints="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069296 2558 flags.go:64] FLAG: --registry-burst="10" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069299 2558 flags.go:64] FLAG: --registry-qps="5" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069302 2558 flags.go:64] FLAG: --reserved-cpus="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069305 2558 flags.go:64] FLAG: --reserved-memory="" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069310 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 15:55:48.075803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069313 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069316 2558 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069320 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069323 2558 flags.go:64] FLAG: --runonce="false" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069326 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069330 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069334 2558 flags.go:64] FLAG: --seccomp-default="false" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069337 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069340 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069343 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069346 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069350 2558 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069353 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069357 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069360 2558 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069363 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069366 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069370 2558 flags.go:64] FLAG: --system-cgroups="" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069372 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069378 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069381 2558 flags.go:64] FLAG: --tls-cert-file="" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069389 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069395 2558 flags.go:64] FLAG: --tls-min-version="" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069398 2558 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069401 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 15:55:48.076493 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069404 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069409 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069413 2558 flags.go:64] FLAG: --v="2" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069422 2558 flags.go:64] FLAG: --version="false" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069426 2558 flags.go:64] FLAG: --vmodule="" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069430 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069434 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069577 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069581 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069585 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069590 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069594 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069597 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069600 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069603 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069606 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069609 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069612 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069615 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069617 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069620 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.077225 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069623 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069626 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069629 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069632 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069634 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069637 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069640 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069644 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069647 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069650 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069653 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069655 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069661 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069664 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069666 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069670 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069672 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069675 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069678 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.077804 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069681 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069683 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069686 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069689 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069692 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069694 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069697 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069700 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069703 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069706 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069708 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069711 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069714 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069717 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069720 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069722 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069725 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069728 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069731 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069733 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.078481 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069738 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069740 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069743 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069746 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069749 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069754 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069757 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069759 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069762 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069765 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069768 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069771 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069774 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069776 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069779 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069782 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069785 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069787 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069790 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069793 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.079117 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069796 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069799 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069802 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069805 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069807 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069810 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069814 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069818 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069821 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069825 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069829 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069832 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069838 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069841 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069844 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069847 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069850 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069855 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069857 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.079680 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069860 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069864 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069867 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069870 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069873 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069875 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.069878 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.069884 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.079965 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.079983 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.080004 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.080014 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080078 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080083 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.080213 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080087 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080091 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080094 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080099 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080103 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080107 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080110 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080113 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080116 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080119 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080122 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080125 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080128 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080131 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080134 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080137 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080140 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080144 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080147 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080149 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.080610 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080152 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080172 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080176 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080179 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080182 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080185 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080188 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080191 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080195 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080198 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080200 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080203 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080206 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080209 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080212 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080215 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080218 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080221 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080224 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080227 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.081129 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080229 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080232 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080235 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080238 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080242 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080245 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080247 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080250 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080253 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080256 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080259 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080262 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080265 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080267 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080271 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080274 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080276 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080281 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080285 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.081676 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080289 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080293 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080296 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080299 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080303 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080306 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080309 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080311 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080314 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080317 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080320 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080322 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080326 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080328 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080331 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080334 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080338 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080342 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080346 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.082178 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080349 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080353 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080356 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080358 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080361 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080364 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080367 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080370 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080374 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080376 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080379 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080383 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080386 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080389 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080392 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080395 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080398 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080401 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.082683 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080404 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.080409 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080543 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080549 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080552 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080556 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080559 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080562 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080566 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080569 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080572 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080575 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080577 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080580 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080584 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 15:55:48.083262 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080587 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080590 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080593 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080595 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080598 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080601 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080604 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080607 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080609 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080613 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080616 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080620 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080622 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080625 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080628 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080631 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080634 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080636 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080639 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 15:55:48.083770 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080642 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080645 2558 feature_gate.go:328] unrecognized feature gate: Example Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080647 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080650 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080654 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080658 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080661 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080664 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080666 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080669 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080672 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080675 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080678 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080681 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080684 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080687 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080690 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080692 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080695 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 15:55:48.084290 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080698 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080701 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080704 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080707 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080710 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080713 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080715 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080718 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080721 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080724 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080727 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080730 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080733 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080735 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080738 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080741 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080745 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080748 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080752 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 15:55:48.084790 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080757 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080760 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080763 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080766 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080769 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080772 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080774 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080777 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080781 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080784 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080786 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080789 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080791 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080795 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080798 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080801 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080803 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080806 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080809 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080812 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 15:55:48.085327 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080815 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080818 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080821 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080823 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080826 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080829 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080832 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080834 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:48.080837 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.080843 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.080961 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 15:55:48.085857 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.085312 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 15:55:48.087111 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.087097 2558 server.go:1019] "Starting client certificate rotation" Jul 08 15:55:48.087217 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.087198 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 15:55:48.087257 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.087235 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 15:55:48.089992 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.089978 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 15:55:48.091638 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.091621 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 15:55:48.108459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.108437 2558 log.go:25] "Validated CRI v1 runtime API" Jul 08 15:55:48.112311 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.112293 2558 log.go:25] "Validated CRI v1 image API" Jul 08 15:55:48.113153 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.113138 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 15:55:48.116475 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.116455 2558 fs.go:135] Filesystem UUIDs: map[2df6353a-57b5-48a1-82ee-ca746c9ef709:/dev/nvme0n1p3 77863cfe-e0a9-49b5-a7d3-81453272ab44:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 08 15:55:48.116535 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.116475 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 15:55:48.124365 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.124343 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 15:55:48.124672 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.124554 2558 manager.go:216] Machine: {Timestamp:2026-07-08 15:55:48.122579073 +0000 UTC m=+0.400674951 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096043 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27b1f82253513b3277a8570ac56e06 SystemUUID:ec27b1f8-2253-513b-3277-a8570ac56e06 BootID:bd745b8e-7eb1-4f0c-8ebc-26e66a5c1089 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:74:8e:18:a7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:74:8e:18:a7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:46:9b:6d:5b:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 15:55:48.124672 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.124669 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 15:55:48.124783 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.124771 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 15:55:48.127617 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.127580 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 15:55:48.127799 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.127621 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-249.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 15:55:48.128540 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.128528 2558 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 15:55:48.128612 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.128547 2558 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 15:55:48.128612 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.128558 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 15:55:48.130440 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.130427 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 15:55:48.132124 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.132112 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 15:55:48.135654 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.135640 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 08 15:55:48.136015 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136000 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 15:55:48.136093 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136045 2558 kubelet.go:486] "Attempting to sync node with API server" Jul 08 15:55:48.136093 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136061 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 15:55:48.136093 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136082 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 15:55:48.136246 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136104 2558 kubelet.go:398] "Adding apiserver pod source" Jul 08 15:55:48.136246 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136118 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 15:55:48.136539 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136524 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 15:55:48.136611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.136549 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 15:55:48.138772 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.138751 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 15:55:48.141098 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.141079 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 15:55:48.141149 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.141117 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 15:55:48.142579 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142567 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 15:55:48.142618 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142585 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 15:55:48.142618 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142594 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 15:55:48.142618 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142603 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 15:55:48.142618 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142618 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142626 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142635 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142641 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142648 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142653 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142665 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 15:55:48.142740 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.142673 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 15:55:48.143950 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.143939 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 15:55:48.143950 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.143950 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 15:55:48.147787 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.147755 2558 server.go:1268] "Started kubelet" Jul 08 15:55:48.147901 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.147790 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-249.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 15:55:48.148369 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.148320 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 15:55:48.148436 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.148391 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 15:55:48.148485 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.148432 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-249.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 15:55:48.148485 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.148431 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 15:55:48.148485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.148445 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 15:55:48.149493 ip-10-0-128-249 systemd[1]: Started Kubernetes Kubelet. Jul 08 15:55:48.150448 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.150413 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 15:55:48.150687 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.150673 2558 server.go:310] "Adding debug handlers to kubelet server" Jul 08 15:55:48.152523 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.152503 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tgxb" Jul 08 15:55:48.152891 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.152873 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 15:55:48.154755 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.153630 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-249.ec2.internal.18c05b950bf71b40 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-249.ec2.internal,UID:ip-10-0-128-249.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-249.ec2.internal,},FirstTimestamp:2026-07-08 15:55:48.14771488 +0000 UTC m=+0.425810731,LastTimestamp:2026-07-08 15:55:48.14771488 +0000 UTC m=+0.425810731,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-249.ec2.internal,}" Jul 08 15:55:48.158867 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.158848 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tgxb" Jul 08 15:55:48.159277 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.159260 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 15:55:48.159820 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.159800 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 15:55:48.159927 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.159912 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.160393 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160365 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 15:55:48.160393 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160383 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 15:55:48.160555 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160365 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 15:55:48.160555 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160498 2558 reconstruct.go:97] "Volume reconstruction finished" Jul 08 15:55:48.160555 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160508 2558 reconciler.go:29] "Reconciler: start to sync state" Jul 08 15:55:48.160817 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160801 2558 factory.go:55] Registering systemd factory Jul 08 15:55:48.160858 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.160827 2558 factory.go:223] Registration of the systemd container factory successfully Jul 08 15:55:48.161177 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161162 2558 factory.go:153] Registering CRI-O factory Jul 08 15:55:48.161227 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161179 2558 factory.go:223] Registration of the crio container factory successfully Jul 08 15:55:48.161286 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161251 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 15:55:48.161286 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161277 2558 factory.go:103] Registering Raw factory Jul 08 15:55:48.161395 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161293 2558 manager.go:1196] Started watching for new ooms in manager Jul 08 15:55:48.161763 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.161749 2558 manager.go:349] Starting recovery of all containers Jul 08 15:55:48.169331 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.169086 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 15:55:48.172351 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.172326 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:48.176073 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.176053 2558 manager.go:354] Recovery completed Jul 08 15:55:48.177148 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.177123 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-249.ec2.internal\" not found" node="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.180845 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.180833 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.182911 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.182894 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.182981 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.182928 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.182981 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.182943 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.183549 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.183533 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 15:55:48.183549 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.183544 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.183549 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.183546 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 15:55:48.183716 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.183566 2558 state_mem.go:36] "Initialized new in-memory state store" Jul 08 15:55:48.184335 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184319 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.184412 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184347 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.184412 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184358 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.184843 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184832 2558 policy_none.go:49] "None policy: Start" Jul 08 15:55:48.184880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184850 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 15:55:48.184880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.184877 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 15:55:48.185886 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.185876 2558 policy_none.go:47] "Start" Jul 08 15:55:48.231834 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.231814 2558 manager.go:337] "Starting Device Plugin manager" Jul 08 15:55:48.231953 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.231857 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 15:55:48.231953 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.231872 2558 server.go:87] "Starting device plugin registration server" Jul 08 15:55:48.232235 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.232218 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 15:55:48.232357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.232236 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 15:55:48.232357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.232342 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 15:55:48.232464 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.232435 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 15:55:48.232464 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.232444 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 15:55:48.233120 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.233079 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 15:55:48.233230 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.233166 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.321725 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.321659 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 15:55:48.321725 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.321707 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 15:55:48.322838 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.321731 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 15:55:48.322838 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.321768 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 15:55:48.324100 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.324079 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:48.333033 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.333009 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.334638 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.334612 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.334745 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.334651 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.334745 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.334662 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.334745 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.334686 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.342937 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.342918 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.342990 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.342945 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-249.ec2.internal\": node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.359947 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.359922 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.422574 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.422526 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal"] Jul 08 15:55:48.422666 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.422619 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.424497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.424480 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.424557 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.424515 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.424557 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.424526 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.426192 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.426179 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.426329 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.426310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.426388 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.426366 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.428496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428473 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.428496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428496 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.428620 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428503 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.428620 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428514 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.428620 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428515 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.428620 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.428605 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.430092 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.430076 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.430146 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.430135 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 15:55:48.431534 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.431510 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientMemory" Jul 08 15:55:48.431633 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.431546 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 15:55:48.431633 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.431560 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeHasSufficientPID" Jul 08 15:55:48.455071 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.455047 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-249.ec2.internal\" not found" node="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.460085 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.460067 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-249.ec2.internal\" not found" node="ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.461179 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.461137 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.561258 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.561219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.561378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.561266 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.561378 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.561235 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.561378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.561296 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b1070cf4e29bff8acdce8685ad7f5b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-249.ec2.internal\" (UID: \"c8b1070cf4e29bff8acdce8685ad7f5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662284 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.662252 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.662284 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662321 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662339 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662374 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b1070cf4e29bff8acdce8685ad7f5b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-249.ec2.internal\" (UID: \"c8b1070cf4e29bff8acdce8685ad7f5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662375 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cdb0d8359ec72701a0314b977284da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal\" (UID: \"37cdb0d8359ec72701a0314b977284da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.662453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.662350 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c8b1070cf4e29bff8acdce8685ad7f5b-config\") pod \"kube-apiserver-proxy-ip-10-0-128-249.ec2.internal\" (UID: \"c8b1070cf4e29bff8acdce8685ad7f5b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.758707 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.758657 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.763605 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.762777 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.763919 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:48.763905 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:48.862899 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.862853 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:48.965289 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:48.965199 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.067261 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.067222 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.086881 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.086855 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 15:55:49.087029 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.087011 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 15:55:49.087115 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.087051 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 15:55:49.161445 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.161408 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 15:50:48 +0000 UTC" deadline="2028-01-31 11:34:02.975096949 +0000 UTC" Jul 08 15:55:49.161445 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.161440 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13723h38m13.813660934s" Jul 08 15:55:49.168244 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.168221 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.269291 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.269215 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.370249 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.370216 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.406876 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:49.406827 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cdb0d8359ec72701a0314b977284da.slice/crio-6f69f2abda817d244119b69549b9b769a4cdbe49483d88a9f97070953411740e WatchSource:0}: Error finding container 6f69f2abda817d244119b69549b9b769a4cdbe49483d88a9f97070953411740e: Status 404 returned error can't find the container with id 6f69f2abda817d244119b69549b9b769a4cdbe49483d88a9f97070953411740e Jul 08 15:55:49.407322 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:49.407295 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b1070cf4e29bff8acdce8685ad7f5b.slice/crio-288b67116dc6d96736e774f35cc6d8a178c2202e5dace807ca2f68ba4274468a WatchSource:0}: Error finding container 288b67116dc6d96736e774f35cc6d8a178c2202e5dace807ca2f68ba4274468a: Status 404 returned error can't find the container with id 288b67116dc6d96736e774f35cc6d8a178c2202e5dace807ca2f68ba4274468a Jul 08 15:55:49.412297 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.412277 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 15:55:49.470537 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.470493 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.559518 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.559431 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:49.571068 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.571032 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.671153 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:49.671113 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-249.ec2.internal\" not found" Jul 08 15:55:49.722114 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.722086 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:49.761039 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.761009 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" Jul 08 15:55:49.771889 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.771860 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 15:55:49.773179 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.773163 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" Jul 08 15:55:49.786640 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:49.786617 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 15:55:50.137071 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.137038 2558 apiserver.go:52] "Watching apiserver" Jul 08 15:55:50.148819 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.148793 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 15:55:50.149255 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.149229 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-q5qpz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal","openshift-multus/multus-additional-cni-plugins-q2j7f","openshift-network-diagnostics/network-check-target-cx7b4","openshift-network-operator/iptables-alerter-7jdm2","openshift-ovn-kubernetes/ovnkube-node-zzgqm","kube-system/global-pull-secret-syncer-482z8","kube-system/konnectivity-agent-hkxpv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps","openshift-cluster-node-tuning-operator/tuned-6lkgd","openshift-image-registry/node-ca-9nh2v","openshift-multus/multus-dg6cg","openshift-multus/network-metrics-daemon-58zvw","kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal"] Jul 08 15:55:50.151058 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.151035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.151172 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.151145 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:55:50.152631 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.152604 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.152744 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.152678 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:55:50.154058 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.154029 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.155288 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.155266 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:50.155434 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.155403 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:55:50.156809 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.156780 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.157662 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157618 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.157662 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157643 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 15:55:50.157855 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157695 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 15:55:50.157855 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157644 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.157855 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157722 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 15:55:50.158018 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.157929 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-pqpcx\"" Jul 08 15:55:50.158427 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.158406 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.159939 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.159920 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vzl88\"" Jul 08 15:55:50.160048 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.160021 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.160141 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.160099 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 15:55:50.160227 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.160209 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 15:55:50.160335 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.160296 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.160391 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.160359 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.161804 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.161783 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.161901 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.161818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 15:55:50.161987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.161970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 15:55:50.163544 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.163458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.163977 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.163958 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 15:55:50.164123 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164081 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.164123 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164101 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 15:55:50.164315 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164195 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xd5kb\"" Jul 08 15:55:50.164421 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164393 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.164485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164421 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.164485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164430 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.165510 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.164430 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 15:55:50.165510 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.165050 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8fzc\"" Jul 08 15:55:50.165510 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.165130 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.165510 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.165454 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.165781 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.165767 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bpfn6\"" Jul 08 15:55:50.165889 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.165871 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.167063 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.167040 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 15:55:50.167193 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.167093 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 15:55:50.167257 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.167198 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-w9l8x\"" Jul 08 15:55:50.169051 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.169032 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.169782 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.169761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kb2lr\"" Jul 08 15:55:50.169965 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.169950 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.170039 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.170016 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.171632 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.171613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.172609 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.172590 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 15:55:50.172925 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.172908 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 15:55:50.173011 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.172928 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 15:55:50.173194 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173179 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p57ts\"" Jul 08 15:55:50.173795 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-script-lib\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.173880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-dbus\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.173880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173836 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e20189c-8542-4e7c-af5b-5824d893c40e-hosts-file\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.173880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd2ng\" (UniqueName: \"kubernetes.io/projected/c7198ffb-8622-414a-8462-6537510922d4-kube-api-access-sd2ng\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.174006 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-kubelet\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174006 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173950 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-netns\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174006 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.173996 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-etc-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174132 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-bin\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174132 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174072 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174132 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174103 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-registration-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-device-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-var-lib-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174217 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-env-overrides\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174246 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174273 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-sys-fs\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174300 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174326 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpqqs\" (UniqueName: \"kubernetes.io/projected/9e20189c-8542-4e7c-af5b-5824d893c40e-kube-api-access-wpqqs\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.174378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174353 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174417 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-systemd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-ovn\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174502 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-node-log\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174554 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-socket-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174587 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-os-release\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174619 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9992s\" (UniqueName: \"kubernetes.io/projected/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-kube-api-access-9992s\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174653 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-iptables-alerter-script\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174657 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5pxsm\"" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174682 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-systemd-units\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174710 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-slash\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174750 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-netd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.174780 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174777 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzwmd\" (UniqueName: \"kubernetes.io/projected/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kube-api-access-nzwmd\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174851 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cnibin\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174880 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxt79\" (UniqueName: \"kubernetes.io/projected/541930f0-fa02-4c6e-b347-7c7f17f729cc-kube-api-access-fxt79\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174901 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e20189c-8542-4e7c-af5b-5824d893c40e-tmp-dir\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174936 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-host-slash\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-log-socket\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174980 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-config\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.174995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-kubelet-config\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175120 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovn-node-metrics-cert\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-system-cni-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.175446 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175171 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zbr6\" (UniqueName: \"kubernetes.io/projected/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-kube-api-access-4zbr6\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.175930 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.175186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.179837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.179815 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 15:55:50.210790 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.210766 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-44wlr" Jul 08 15:55:50.219577 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.219554 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-44wlr" Jul 08 15:55:50.262422 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.262396 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 15:55:50.273768 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.273738 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:50.276717 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276685 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-etc-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.276837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-bin\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.276837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276764 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.276837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276793 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-registration-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.276837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276818 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-device-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276849 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-tmp\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276876 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-env-overrides\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276916 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276945 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-lib-modules\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276970 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-system-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.276999 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277027 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-os-release\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277051 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-netns\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277078 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-kubelet\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277103 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-systemd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-os-release\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlwv2\" (UniqueName: \"kubernetes.io/projected/9a2d1aec-4121-4172-be69-14b38bf42fcd-kube-api-access-xlwv2\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277211 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-socket-dir-parent\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-iptables-alerter-script\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-systemd-units\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cnibin\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-modprobe-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-etc-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.277496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-registration-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277534 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-device-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277539 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cni-binary-copy\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277684 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-systemd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cnibin\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277811 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-os-release\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.277816 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277851 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-systemd-units\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.277938 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:50.777888096 +0000 UTC m=+3.055983961 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-env-overrides\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.277833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxt79\" (UniqueName: \"kubernetes.io/projected/541930f0-fa02-4c6e-b347-7c7f17f729cc-kube-api-access-fxt79\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278031 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e20189c-8542-4e7c-af5b-5824d893c40e-tmp-dir\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278159 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-bin\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-log-socket\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278230 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-kubelet-config\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278277 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278309 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-conf\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278338 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-system-cni-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278365 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0edba22a-f9a3-4862-881b-861997e41d7a-agent-certs\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278439 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-run\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278500 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a2d1aec-4121-4172-be69-14b38bf42fcd-serviceca\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278505 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-iptables-alerter-script\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-k8s-cni-cncf-io\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278550 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-log-socket\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-etc-kubernetes\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-kubelet-config\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278504 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278607 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-system-cni-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278696 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zbr6\" (UniqueName: \"kubernetes.io/projected/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-kube-api-access-4zbr6\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278708 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.278987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e20189c-8542-4e7c-af5b-5824d893c40e-tmp-dir\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278891 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sd2ng\" (UniqueName: \"kubernetes.io/projected/c7198ffb-8622-414a-8462-6537510922d4-kube-api-access-sd2ng\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278912 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-ovn-kubernetes\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.278974 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-etc-tuned\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-cni-binary-copy\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279081 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-kubernetes\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-netns\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279206 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279232 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-run-netns\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279284 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-sys-fs\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279325 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-sys-fs\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279438 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.279493 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279541 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-var-lib-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.279589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpqqs\" (UniqueName: \"kubernetes.io/projected/9e20189c-8542-4e7c-af5b-5824d893c40e-kube-api-access-wpqqs\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279605 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9992s\" (UniqueName: \"kubernetes.io/projected/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-kube-api-access-9992s\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-var-lib-kubelet\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279736 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp8z8\" (UniqueName: \"kubernetes.io/projected/ec673a74-0cdd-43ff-ad7a-611875724797-kube-api-access-tp8z8\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279791 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-multus-certs\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-ovn\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-node-log\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.279898 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:50.77987984 +0000 UTC m=+3.057975692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279915 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-node-log\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-socket-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279967 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-systemd\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.279963 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-run-ovn\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280120 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280038 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-var-lib-openvswitch\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-socket-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280200 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-bin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280256 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-multus\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280313 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-conf-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-slash\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280412 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-netd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280464 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzwmd\" (UniqueName: \"kubernetes.io/projected/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kube-api-access-nzwmd\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280484 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-slash\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280491 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-hostroot\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280547 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-daemon-config\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcczn\" (UniqueName: \"kubernetes.io/projected/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-kube-api-access-kcczn\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280601 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cnibin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysconfig\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-cni-netd\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.280739 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-host-slash\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280737 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-host-slash\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-config\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280842 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280941 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovn-node-metrics-cert\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.280968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-host\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-script-lib\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281055 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-dbus\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281164 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e20189c-8542-4e7c-af5b-5824d893c40e-hosts-file\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281206 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-sys\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281229 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a2d1aec-4121-4172-be69-14b38bf42fcd-host\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281265 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0edba22a-f9a3-4862-881b-861997e41d7a-konnectivity-ca\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281292 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-kubelet\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281382 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/541930f0-fa02-4c6e-b347-7c7f17f729cc-host-kubelet\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.281611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281441 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-dbus\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.282412 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.281983 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.283575 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-config\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.283679 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.283705 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovnkube-script-lib\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.283934 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9e20189c-8542-4e7c-af5b-5824d893c40e-hosts-file\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.284196 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.286932 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.286956 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:55:50.287000 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.286972 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:50.288127 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.287147 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:50.787129052 +0000 UTC m=+3.065224904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:50.289127 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.289015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/541930f0-fa02-4c6e-b347-7c7f17f729cc-ovn-node-metrics-cert\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.296182 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.293249 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd2ng\" (UniqueName: \"kubernetes.io/projected/c7198ffb-8622-414a-8462-6537510922d4-kube-api-access-sd2ng\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.296182 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.293818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxt79\" (UniqueName: \"kubernetes.io/projected/541930f0-fa02-4c6e-b347-7c7f17f729cc-kube-api-access-fxt79\") pod \"ovnkube-node-zzgqm\" (UID: \"541930f0-fa02-4c6e-b347-7c7f17f729cc\") " pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.296182 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.294765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9992s\" (UniqueName: \"kubernetes.io/projected/b2f55dfb-8b69-4985-b0c4-d256eca18e0b-kube-api-access-9992s\") pod \"multus-additional-cni-plugins-q2j7f\" (UID: \"b2f55dfb-8b69-4985-b0c4-d256eca18e0b\") " pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.296418 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.296216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zbr6\" (UniqueName: \"kubernetes.io/projected/4b61aca2-9ccf-40d3-9328-bd6bcd47067a-kube-api-access-4zbr6\") pod \"iptables-alerter-7jdm2\" (UID: \"4b61aca2-9ccf-40d3-9328-bd6bcd47067a\") " pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.298012 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.297985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzwmd\" (UniqueName: \"kubernetes.io/projected/5f6f22a1-d713-49a9-a4b6-57cc83251c3b-kube-api-access-nzwmd\") pod \"aws-ebs-csi-driver-node-xxrps\" (UID: \"5f6f22a1-d713-49a9-a4b6-57cc83251c3b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.300311 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.300288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpqqs\" (UniqueName: \"kubernetes.io/projected/9e20189c-8542-4e7c-af5b-5824d893c40e-kube-api-access-wpqqs\") pod \"node-resolver-q5qpz\" (UID: \"9e20189c-8542-4e7c-af5b-5824d893c40e\") " pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.325459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.324258 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 15:55:50.328856 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.328805 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" event={"ID":"c8b1070cf4e29bff8acdce8685ad7f5b","Type":"ContainerStarted","Data":"288b67116dc6d96736e774f35cc6d8a178c2202e5dace807ca2f68ba4274468a"} Jul 08 15:55:50.330433 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.330405 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" event={"ID":"37cdb0d8359ec72701a0314b977284da","Type":"ContainerStarted","Data":"6f69f2abda817d244119b69549b9b769a4cdbe49483d88a9f97070953411740e"} Jul 08 15:55:50.381858 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.381820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlwv2\" (UniqueName: \"kubernetes.io/projected/9a2d1aec-4121-4172-be69-14b38bf42fcd-kube-api-access-xlwv2\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.381873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-socket-dir-parent\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.381920 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-modprobe-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.381951 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cni-binary-copy\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.381980 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-conf\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382006 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0edba22a-f9a3-4862-881b-861997e41d7a-agent-certs\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-run\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382052 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a2d1aec-4121-4172-be69-14b38bf42fcd-serviceca\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.382459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-k8s-cni-cncf-io\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382112 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-etc-kubernetes\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-etc-tuned\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382670 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382498 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-modprobe-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382670 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-kubernetes\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382779 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382779 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382750 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-var-lib-kubelet\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382888 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp8z8\" (UniqueName: \"kubernetes.io/projected/ec673a74-0cdd-43ff-ad7a-611875724797-kube-api-access-tp8z8\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382888 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-multus-certs\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382888 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382838 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-systemd\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.382888 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-socket-dir-parent\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.382888 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-bin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382928 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-bin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-kubernetes\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.382997 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-multus-certs\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383036 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-var-lib-kubelet\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383040 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-systemd\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-etc-kubernetes\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383143 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383100 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-k8s-cni-cncf-io\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383193 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-d\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-multus\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383264 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-conf-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383295 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-hostroot\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383320 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-daemon-config\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcczn\" (UniqueName: \"kubernetes.io/projected/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-kube-api-access-kcczn\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cnibin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysconfig\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-host\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383497 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383484 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-sys\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383507 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a2d1aec-4121-4172-be69-14b38bf42fcd-host\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0edba22a-f9a3-4862-881b-861997e41d7a-konnectivity-ca\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383524 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9a2d1aec-4121-4172-be69-14b38bf42fcd-serviceca\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383568 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-tmp\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383609 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-run\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383627 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-lib-modules\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383652 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-system-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383706 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-os-release\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383709 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cni-binary-copy\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-netns\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383763 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-kubelet\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383850 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysctl-conf\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383893 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-cni-multus\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-var-lib-kubelet\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-conf-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.383997 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.383978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9a2d1aec-4121-4172-be69-14b38bf42fcd-host\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384029 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-hostroot\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384111 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-system-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384503 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0edba22a-f9a3-4862-881b-861997e41d7a-konnectivity-ca\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-daemon-config\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384678 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-multus-cni-dir\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384751 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-os-release\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-cnibin\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384815 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-host-run-netns\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-host\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384863 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-sys\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.384909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384891 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-etc-sysconfig\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.385489 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.384973 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec673a74-0cdd-43ff-ad7a-611875724797-lib-modules\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.386067 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.386039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0edba22a-f9a3-4862-881b-861997e41d7a-agent-certs\") pod \"konnectivity-agent-hkxpv\" (UID: \"0edba22a-f9a3-4862-881b-861997e41d7a\") " pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.386967 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.386942 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-etc-tuned\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.387568 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.387515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ec673a74-0cdd-43ff-ad7a-611875724797-tmp\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.396385 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.396357 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcczn\" (UniqueName: \"kubernetes.io/projected/cc61a4a9-39c8-4b2f-be2a-e40c76f1d100-kube-api-access-kcczn\") pod \"multus-dg6cg\" (UID: \"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100\") " pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.396822 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.396761 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlwv2\" (UniqueName: \"kubernetes.io/projected/9a2d1aec-4121-4172-be69-14b38bf42fcd-kube-api-access-xlwv2\") pod \"node-ca-9nh2v\" (UID: \"9a2d1aec-4121-4172-be69-14b38bf42fcd\") " pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.397583 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.397559 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp8z8\" (UniqueName: \"kubernetes.io/projected/ec673a74-0cdd-43ff-ad7a-611875724797-kube-api-access-tp8z8\") pod \"tuned-6lkgd\" (UID: \"ec673a74-0cdd-43ff-ad7a-611875724797\") " pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.467809 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.467776 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" Jul 08 15:55:50.477795 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.477712 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7jdm2" Jul 08 15:55:50.481359 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.481317 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f55dfb_8b69_4985_b0c4_d256eca18e0b.slice/crio-4e8a1d842f64e596a2332f50d5ff72ca8013842bca05ec4153d8194e9611704b WatchSource:0}: Error finding container 4e8a1d842f64e596a2332f50d5ff72ca8013842bca05ec4153d8194e9611704b: Status 404 returned error can't find the container with id 4e8a1d842f64e596a2332f50d5ff72ca8013842bca05ec4153d8194e9611704b Jul 08 15:55:50.484110 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.483934 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:55:50.487450 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.487412 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b61aca2_9ccf_40d3_9328_bd6bcd47067a.slice/crio-ef8a42129c7e880fbce22cbd07792cfacfe7ad70a4a4f53e99950165d5e6d45c WatchSource:0}: Error finding container ef8a42129c7e880fbce22cbd07792cfacfe7ad70a4a4f53e99950165d5e6d45c: Status 404 returned error can't find the container with id ef8a42129c7e880fbce22cbd07792cfacfe7ad70a4a4f53e99950165d5e6d45c Jul 08 15:55:50.488179 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.488137 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" Jul 08 15:55:50.493822 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.493796 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541930f0_fa02_4c6e_b347_7c7f17f729cc.slice/crio-789bd74d9a094884fdb69506419b1b6ce72fb139578908f410d112c15456e022 WatchSource:0}: Error finding container 789bd74d9a094884fdb69506419b1b6ce72fb139578908f410d112c15456e022: Status 404 returned error can't find the container with id 789bd74d9a094884fdb69506419b1b6ce72fb139578908f410d112c15456e022 Jul 08 15:55:50.494876 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.494852 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-q5qpz" Jul 08 15:55:50.498805 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.498779 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f6f22a1_d713_49a9_a4b6_57cc83251c3b.slice/crio-be97ef0d3211ef97686f036511893c8517ab1ce1ef1c1d58a2435c0f2c8c3948 WatchSource:0}: Error finding container be97ef0d3211ef97686f036511893c8517ab1ce1ef1c1d58a2435c0f2c8c3948: Status 404 returned error can't find the container with id be97ef0d3211ef97686f036511893c8517ab1ce1ef1c1d58a2435c0f2c8c3948 Jul 08 15:55:50.500380 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.500340 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:55:50.505655 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.505625 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e20189c_8542_4e7c_af5b_5824d893c40e.slice/crio-350f8fd42de6d9dc9105868b6b2328b0366d3fd9a7204a870c85e330d7e0ccf1 WatchSource:0}: Error finding container 350f8fd42de6d9dc9105868b6b2328b0366d3fd9a7204a870c85e330d7e0ccf1: Status 404 returned error can't find the container with id 350f8fd42de6d9dc9105868b6b2328b0366d3fd9a7204a870c85e330d7e0ccf1 Jul 08 15:55:50.507340 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.507193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" Jul 08 15:55:50.510975 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.510948 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edba22a_f9a3_4862_881b_861997e41d7a.slice/crio-15fe02905979480e27bdbb64e6f7120fee8e3cdc37073f626e403a5de9a34330 WatchSource:0}: Error finding container 15fe02905979480e27bdbb64e6f7120fee8e3cdc37073f626e403a5de9a34330: Status 404 returned error can't find the container with id 15fe02905979480e27bdbb64e6f7120fee8e3cdc37073f626e403a5de9a34330 Jul 08 15:55:50.515389 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.515361 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9nh2v" Jul 08 15:55:50.517615 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.517587 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec673a74_0cdd_43ff_ad7a_611875724797.slice/crio-29b12517cf2ce121d56a9948a4597c03bfeb1a46a6b8474775a7ac1385df142f WatchSource:0}: Error finding container 29b12517cf2ce121d56a9948a4597c03bfeb1a46a6b8474775a7ac1385df142f: Status 404 returned error can't find the container with id 29b12517cf2ce121d56a9948a4597c03bfeb1a46a6b8474775a7ac1385df142f Jul 08 15:55:50.521768 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.521738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dg6cg" Jul 08 15:55:50.539417 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:55:50.539381 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc61a4a9_39c8_4b2f_be2a_e40c76f1d100.slice/crio-afdc2b280e6fd3e2d7589fb4dd476ed852942196e233a664ca8ff49256515e69 WatchSource:0}: Error finding container afdc2b280e6fd3e2d7589fb4dd476ed852942196e233a664ca8ff49256515e69: Status 404 returned error can't find the container with id afdc2b280e6fd3e2d7589fb4dd476ed852942196e233a664ca8ff49256515e69 Jul 08 15:55:50.786573 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.786486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:50.786735 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.786575 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:50.786735 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.786685 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:50.786850 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.786769 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:51.786748718 +0000 UTC m=+4.064844556 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:50.786850 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.786690 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:50.786943 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.786859 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:51.786838781 +0000 UTC m=+4.064934636 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:50.887744 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:50.887698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:50.887944 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.887919 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:55:50.888016 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.887949 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:55:50.888016 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.887965 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:50.888141 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:50.888042 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:51.888020438 +0000 UTC m=+4.166116310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:51.221838 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.221753 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:50:50 +0000 UTC" deadline="2028-03-23 16:45:48.093417494 +0000 UTC" Jul 08 15:55:51.221838 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.221828 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14976h49m56.87159282s" Jul 08 15:55:51.322369 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.322336 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:51.322554 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.322489 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:55:51.334742 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.334703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jdm2" event={"ID":"4b61aca2-9ccf-40d3-9328-bd6bcd47067a","Type":"ContainerStarted","Data":"ef8a42129c7e880fbce22cbd07792cfacfe7ad70a4a4f53e99950165d5e6d45c"} Jul 08 15:55:51.337066 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.337035 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dg6cg" event={"ID":"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100","Type":"ContainerStarted","Data":"afdc2b280e6fd3e2d7589fb4dd476ed852942196e233a664ca8ff49256515e69"} Jul 08 15:55:51.339758 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.339730 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" event={"ID":"ec673a74-0cdd-43ff-ad7a-611875724797","Type":"ContainerStarted","Data":"29b12517cf2ce121d56a9948a4597c03bfeb1a46a6b8474775a7ac1385df142f"} Jul 08 15:55:51.341404 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.341376 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5qpz" event={"ID":"9e20189c-8542-4e7c-af5b-5824d893c40e","Type":"ContainerStarted","Data":"350f8fd42de6d9dc9105868b6b2328b0366d3fd9a7204a870c85e330d7e0ccf1"} Jul 08 15:55:51.343617 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.343591 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" event={"ID":"5f6f22a1-d713-49a9-a4b6-57cc83251c3b","Type":"ContainerStarted","Data":"be97ef0d3211ef97686f036511893c8517ab1ce1ef1c1d58a2435c0f2c8c3948"} Jul 08 15:55:51.345790 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.345718 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"789bd74d9a094884fdb69506419b1b6ce72fb139578908f410d112c15456e022"} Jul 08 15:55:51.347942 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.347916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerStarted","Data":"4e8a1d842f64e596a2332f50d5ff72ca8013842bca05ec4153d8194e9611704b"} Jul 08 15:55:51.349173 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.349137 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nh2v" event={"ID":"9a2d1aec-4121-4172-be69-14b38bf42fcd","Type":"ContainerStarted","Data":"7cb2780437f6476c3ce710e542f96cb9b77abda7952d5bf6783693c869d78a96"} Jul 08 15:55:51.350427 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.350398 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkxpv" event={"ID":"0edba22a-f9a3-4862-881b-861997e41d7a","Type":"ContainerStarted","Data":"15fe02905979480e27bdbb64e6f7120fee8e3cdc37073f626e403a5de9a34330"} Jul 08 15:55:51.797205 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.797096 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:51.797205 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.797160 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:51.797411 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.797302 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:51.797411 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.797373 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:53.797353331 +0000 UTC m=+6.075449170 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:51.797411 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.797302 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:51.797568 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.797488 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:53.797464992 +0000 UTC m=+6.075560834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:51.897849 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:51.897593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:51.898010 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.897946 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:55:51.898010 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.897974 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:55:51.898160 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.897988 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:51.898160 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:51.898137 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:53.898116363 +0000 UTC m=+6.176212203 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:52.222373 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:52.222328 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 15:50:50 +0000 UTC" deadline="2028-04-22 22:59:06.613272258 +0000 UTC" Jul 08 15:55:52.222373 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:52.222372 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15703h3m14.390905598s" Jul 08 15:55:52.322254 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:52.322209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:52.322598 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:52.322434 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:55:52.322598 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:52.322525 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:52.322736 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:52.322652 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:55:53.324360 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:53.324324 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:53.324829 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.324524 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:55:53.815403 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:53.815347 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:53.815600 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:53.815463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:53.815600 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.815596 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:53.815721 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.815656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:57.815638716 +0000 UTC m=+10.093734553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:53.816051 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.816032 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:53.816152 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.816103 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:57.81607123 +0000 UTC m=+10.094167070 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:53.916282 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:53.916247 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:53.916467 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.916422 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:55:53.916467 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.916441 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:55:53.916467 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.916453 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:53.916630 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:53.916512 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:55:57.916494853 +0000 UTC m=+10.194590701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:54.323235 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:54.323186 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:54.323425 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:54.323329 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:55:54.323425 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:54.323382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:54.323540 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:54.323495 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:55:55.323565 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:55.323025 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:55.323565 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:55.323206 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:55:56.322549 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:56.322360 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:56.322549 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:56.322502 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:55:56.323016 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:56.322975 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:56.323178 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:56.323104 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:55:57.322302 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:57.322262 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:57.322803 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.322414 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:57.850787 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:57.850900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.850914 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.850990 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:05.8509691 +0000 UTC m=+18.129064941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.851020 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:57.851118 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.851077 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:05.851062075 +0000 UTC m=+18.129157914 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:55:57.952310 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:57.952273 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:57.952489 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.952452 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:55:57.952489 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.952472 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:55:57.952489 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.952484 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:57.952648 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:57.952545 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:05.952524713 +0000 UTC m=+18.230620550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:55:58.325796 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:58.325758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:55:58.326270 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:58.325892 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:55:58.328983 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:58.326376 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:55:58.328983 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:58.326514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:55:59.322131 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:55:59.322094 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:55:59.322331 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:55:59.322237 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:00.322908 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:00.322873 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:00.323375 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:00.323110 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:00.323500 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:00.323482 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:00.323607 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:00.323583 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:01.322473 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:01.322385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:01.322641 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:01.322528 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:02.323476 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:02.323022 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:02.323476 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:02.323022 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:02.323476 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:02.323192 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:02.323476 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:02.323286 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:03.322694 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:03.322655 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:03.322895 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:03.322793 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:04.322139 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:04.322104 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:04.322637 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:04.322147 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:04.322637 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:04.322234 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:04.322637 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:04.322354 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:05.322455 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:05.322425 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:05.322895 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:05.322554 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:05.913447 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:05.913410 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:05.913626 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:05.913488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:05.913626 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:05.913550 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:56:05.913626 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:05.913615 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:56:05.913757 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:05.913622 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:21.913603227 +0000 UTC m=+34.191699062 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:56:05.913757 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:05.913685 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:21.91367331 +0000 UTC m=+34.191769145 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:56:06.014473 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:06.014433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:06.014657 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.014569 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:56:06.014657 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.014583 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:56:06.014657 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.014592 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:56:06.014657 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.014656 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:22.014638314 +0000 UTC m=+34.292734149 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:56:06.322428 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:06.322345 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:06.322608 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.322494 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:06.322608 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:06.322549 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:06.323016 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:06.322662 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:07.322732 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:07.322672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:07.323275 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:07.322816 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:08.323074 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:08.323035 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:08.323534 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:08.323156 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:08.323534 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:08.323216 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:08.323534 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:08.323343 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:09.322955 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:09.322915 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:09.323152 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:09.323055 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:10.322393 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.322223 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:10.322529 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.322277 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:10.322529 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:10.322468 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:10.322614 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:10.322589 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:10.399661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.399627 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" event={"ID":"c8b1070cf4e29bff8acdce8685ad7f5b","Type":"ContainerStarted","Data":"b99b19b939a68b8ec5a66b189f91aeda26a47a2f0494f4f42d3422d6444cd218"} Jul 08 15:56:10.404651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.404620 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dg6cg" event={"ID":"cc61a4a9-39c8-4b2f-be2a-e40c76f1d100","Type":"ContainerStarted","Data":"497b44a036fba199052af747ad4ec6c324767b72ebdf157810d2558ba6b489c3"} Jul 08 15:56:10.406820 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.406792 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" event={"ID":"ec673a74-0cdd-43ff-ad7a-611875724797","Type":"ContainerStarted","Data":"de4ec96474193dec860159565895dbd52d6eaed29c1dafab08043b8659af622b"} Jul 08 15:56:10.408792 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.408773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 15:56:10.409268 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.409242 2558 generic.go:356] "Generic (PLEG): container finished" podID="541930f0-fa02-4c6e-b347-7c7f17f729cc" containerID="22c2206280d74e720ee24b4c6684da182a173aff4a7e31116de016013c158147" exitCode=1 Jul 08 15:56:10.409358 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.409281 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"ace41288f00b90820cd11082c955476d50e715770b46bb2ddcda874f9da1e39f"} Jul 08 15:56:10.409358 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.409355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerDied","Data":"22c2206280d74e720ee24b4c6684da182a173aff4a7e31116de016013c158147"} Jul 08 15:56:10.409455 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.409400 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"7bd6139997f75af30e8f03fe3a33cbdcb24d1513f7b69988acd3ebb5b0823875"} Jul 08 15:56:10.417427 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.417370 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-249.ec2.internal" podStartSLOduration=21.417351657 podStartE2EDuration="21.417351657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:10.417065026 +0000 UTC m=+22.695160885" watchObservedRunningTime="2026-07-08 15:56:10.417351657 +0000 UTC m=+22.695447515" Jul 08 15:56:10.475453 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:10.475403 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6lkgd" podStartSLOduration=3.571374749 podStartE2EDuration="22.475384237s" totalImagesPullingTime="18.904009488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:10.438431571 +0000 UTC m=+22.716527427" watchObservedRunningTime="2026-07-08 15:56:10.475384237 +0000 UTC m=+22.753480093" Jul 08 15:56:11.322448 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.322264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:11.322655 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:11.322529 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:11.412747 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.412718 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-q5qpz" event={"ID":"9e20189c-8542-4e7c-af5b-5824d893c40e","Type":"ContainerStarted","Data":"de481e4bdd9bedc59c9ced970150bf3dda1af1ef451cce97042e8f49d342a5ef"} Jul 08 15:56:11.414136 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.414111 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" event={"ID":"5f6f22a1-d713-49a9-a4b6-57cc83251c3b","Type":"ContainerStarted","Data":"66a9137daf3a027d0f8f5a1244cb1b776b612d17d432be53adbae885b9f024b7"} Jul 08 15:56:11.416426 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.416407 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 15:56:11.416871 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.416850 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"8e2e18ff34e91bef19c1a57e0ec1bcba712b30c076f83e2db9682c9780427741"} Jul 08 15:56:11.416933 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.416916 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"861cee5474599ba618de9e4016ae685cb0198e65589ca1d2aa3b9584a652b51a"} Jul 08 15:56:11.416982 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.416967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"f18eb988c045d9a64e8e44c5b084c6b46a0df24ddd558c8db061340d2a333a08"} Jul 08 15:56:11.418260 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.418231 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="fe4228ef45ab71e63c9988877a0d952911e9428b13ada90bcf6177f8443edad4" exitCode=0 Jul 08 15:56:11.418357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.418308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"fe4228ef45ab71e63c9988877a0d952911e9428b13ada90bcf6177f8443edad4"} Jul 08 15:56:11.419876 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.419855 2558 generic.go:356] "Generic (PLEG): container finished" podID="37cdb0d8359ec72701a0314b977284da" containerID="ca3b2bb91013997d1ead10a1fe71ed0dd8296eb38642e6fceb59896fdeee68f4" exitCode=0 Jul 08 15:56:11.419937 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.419904 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" event={"ID":"37cdb0d8359ec72701a0314b977284da","Type":"ContainerDied","Data":"ca3b2bb91013997d1ead10a1fe71ed0dd8296eb38642e6fceb59896fdeee68f4"} Jul 08 15:56:11.421476 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.421453 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9nh2v" event={"ID":"9a2d1aec-4121-4172-be69-14b38bf42fcd","Type":"ContainerStarted","Data":"228a2138791d0cfad56aa07abc77d03c41f9579a7246f998f26e70b6ea653094"} Jul 08 15:56:11.422781 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.422754 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hkxpv" event={"ID":"0edba22a-f9a3-4862-881b-861997e41d7a","Type":"ContainerStarted","Data":"1f84b6bfbfaff6d5eb9fe8e35553dd95be43edde95e10e1b385083bd78ffd3e7"} Jul 08 15:56:11.424053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.424033 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7jdm2" event={"ID":"4b61aca2-9ccf-40d3-9328-bd6bcd47067a","Type":"ContainerStarted","Data":"a5a86e481c35436597af06c4c70c62b214548cb0eaccbe6f5cc8b6955efae46b"} Jul 08 15:56:11.430380 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.430342 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-q5qpz" podStartSLOduration=4.507515579 podStartE2EDuration="23.43033002s" totalImagesPullingTime="18.922814441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:11.430044957 +0000 UTC m=+23.708140814" watchObservedRunningTime="2026-07-08 15:56:11.43033002 +0000 UTC m=+23.708425877" Jul 08 15:56:11.430943 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.430915 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dg6cg" podStartSLOduration=4.528288612 podStartE2EDuration="23.430905551s" totalImagesPullingTime="18.902616939s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:10.47488563 +0000 UTC m=+22.752981486" watchObservedRunningTime="2026-07-08 15:56:11.430905551 +0000 UTC m=+23.709001408" Jul 08 15:56:11.484871 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.484813 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7jdm2" podStartSLOduration=4.594840137 podStartE2EDuration="23.484795166s" totalImagesPullingTime="18.889955029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:11.484561703 +0000 UTC m=+23.762657583" watchObservedRunningTime="2026-07-08 15:56:11.484795166 +0000 UTC m=+23.762891027" Jul 08 15:56:11.501918 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.501874 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9nh2v" podStartSLOduration=4.614546747 podStartE2EDuration="23.501854576s" totalImagesPullingTime="18.887307829s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:11.501313362 +0000 UTC m=+23.779409260" watchObservedRunningTime="2026-07-08 15:56:11.501854576 +0000 UTC m=+23.779950432" Jul 08 15:56:11.541180 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.541119 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hkxpv" podStartSLOduration=4.6339751620000005 podStartE2EDuration="23.541098878s" totalImagesPullingTime="18.907123716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:11.540792547 +0000 UTC m=+23.818888404" watchObservedRunningTime="2026-07-08 15:56:11.541098878 +0000 UTC m=+23.819194730" Jul 08 15:56:11.564036 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:11.563998 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:12.322960 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.322931 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:12.322960 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.322953 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:12.323350 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:12.323047 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:12.323350 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:12.323120 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:12.429662 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.429624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" event={"ID":"37cdb0d8359ec72701a0314b977284da","Type":"ContainerStarted","Data":"f78d5306a28f423e9ea751a76c39cdbe5b2f6ca5c08de597367655063f9bb2ab"} Jul 08 15:56:12.452243 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.452179 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-249.ec2.internal" podStartSLOduration=23.452156606 podStartE2EDuration="23.452156606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:12.451596398 +0000 UTC m=+24.729692274" watchObservedRunningTime="2026-07-08 15:56:12.452156606 +0000 UTC m=+24.730252464" Jul 08 15:56:12.512767 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.512736 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 15:56:12.654432 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:12.654400 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:13.247868 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.247752 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T15:56:12.512759075Z","UUID":"4f373fb8-b05d-408d-925f-460d3fbad7d1","Handler":null,"Name":"","Endpoint":""} Jul 08 15:56:13.249756 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.249688 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 15:56:13.249756 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.249733 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 15:56:13.322930 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.322899 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:13.323101 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:13.323024 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:13.406250 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.406215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:13.434727 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.434692 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" event={"ID":"5f6f22a1-d713-49a9-a4b6-57cc83251c3b","Type":"ContainerStarted","Data":"68cf8b2080701d248c86ecdbf19c1de9359fa57fae1ce94614c3f4ea272611c1"} Jul 08 15:56:13.438540 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.438515 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 15:56:13.439053 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.439013 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"700ac71724ff6c4d60563cd712e90b43de3060952aed09fab343152883ddbb5e"} Jul 08 15:56:13.507767 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.507625 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:13.614127 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.613945 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:13.714847 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.714805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:13.783876 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:13.783775 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:14.322668 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.322637 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:14.322878 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.322637 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:14.322878 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:14.322782 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:14.322878 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:14.322832 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:14.328439 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.328411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:14.444096 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.444058 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" event={"ID":"5f6f22a1-d713-49a9-a4b6-57cc83251c3b","Type":"ContainerStarted","Data":"852964d5fef8ad3e20af5eb4a91b19aa25e00045dbe8f59b54fc61ecd94b0b34"} Jul 08 15:56:14.466428 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.466377 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxrps" podStartSLOduration=5.116277673 podStartE2EDuration="26.466356315s" totalImagesPullingTime="21.350078642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:14.465637578 +0000 UTC m=+26.743733435" watchObservedRunningTime="2026-07-08 15:56:14.466356315 +0000 UTC m=+26.744452173" Jul 08 15:56:14.893296 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:14.893255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:15.300442 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.300354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:15.322581 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.322555 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:15.322735 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:15.322672 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:15.450222 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.450196 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 15:56:15.450941 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.450550 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"4c3b6774ba8a702fa51df53d46ba10e6437f68c7ca036d54d29c4ff5390cadc9"} Jul 08 15:56:15.451127 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.451113 2558 scope.go:117] "RemoveContainer" containerID="22c2206280d74e720ee24b4c6684da182a173aff4a7e31116de016013c158147" Jul 08 15:56:15.701074 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.700890 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:15.920163 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.920132 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:56:15.920823 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.920805 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:56:15.925180 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:15.925154 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:16.296346 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.296308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:16.322492 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.322461 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:16.322680 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.322462 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:16.322680 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:16.322591 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:16.322680 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:16.322650 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:16.397567 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.397538 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:16.456883 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.456854 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 15:56:16.457342 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.457315 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" event={"ID":"541930f0-fa02-4c6e-b347-7c7f17f729cc","Type":"ContainerStarted","Data":"4a6b5b96bb2c257e5c91b8de6b17b071aab6df2d1bdecfc99f0827702ef3044a"} Jul 08 15:56:16.457439 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.457424 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 15:56:16.457692 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.457667 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:56:16.457796 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.457779 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:16.457912 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.457878 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:16.458400 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.458378 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hkxpv" Jul 08 15:56:16.475258 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.475231 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:16.476771 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.476750 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:16.490745 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.490698 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" podStartSLOduration=8.896336951 podStartE2EDuration="28.49068285s" totalImagesPullingTime="19.594345899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:16.488373278 +0000 UTC m=+28.766469134" watchObservedRunningTime="2026-07-08 15:56:16.49068285 +0000 UTC m=+28.768778706" Jul 08 15:56:16.587116 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.587019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:16.658615 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:16.658529 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.128077 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.128031 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.294598 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.294565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.322856 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.322823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:17.323013 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:17.322942 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:17.396307 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.396207 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.460238 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.460209 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 15:56:17.703724 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.703650 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.917880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.917847 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:17.973753 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:17.973723 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:18.323480 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.323390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:18.323480 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.323459 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:18.323692 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:18.323514 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:18.323692 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:18.323538 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:18.463515 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.463481 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="1144e5d818ef2b06d613598e7928a149ffd939264b7d1a79c695cb8e5174b212" exitCode=0 Jul 08 15:56:18.463976 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.463572 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"1144e5d818ef2b06d613598e7928a149ffd939264b7d1a79c695cb8e5174b212"} Jul 08 15:56:18.463976 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.463620 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 15:56:18.496396 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.496365 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:18.893418 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:18.893374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:19.297472 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:19.297391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:19.322590 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:19.322546 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:19.322748 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:19.322705 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:19.696982 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:19.696951 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:19.764028 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:19.764001 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:19.891238 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:19.891201 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.146408 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.146374 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.247589 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.247561 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:20.247742 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.247563 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.247815 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.247800 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 15:56:20.257248 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.257211 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" podUID="541930f0-fa02-4c6e-b347-7c7f17f729cc" containerName="ovnkube-controller" probeResult="failure" output="" Jul 08 15:56:20.265525 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.265498 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" podUID="541930f0-fa02-4c6e-b347-7c7f17f729cc" containerName="ovnkube-controller" probeResult="failure" output="" Jul 08 15:56:20.322673 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.322639 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:20.322799 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.322678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:20.322799 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:20.322763 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:20.322897 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:20.322876 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:20.374928 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.374891 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.471604 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.471523 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="754fb99f52f327a1906b67aa5767df03f6e0cde2947bbed4e116de18a2c2c247" exitCode=0 Jul 08 15:56:20.471604 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.471560 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"754fb99f52f327a1906b67aa5767df03f6e0cde2947bbed4e116de18a2c2c247"} Jul 08 15:56:20.554331 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.554295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.621611 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.621577 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.818475 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.818378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:20.920130 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:20.920097 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.090419 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.090347 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.283852 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.283823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.322873 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.322849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:21.322992 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:21.322970 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:21.384720 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.384688 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.476150 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.476115 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="cfa34b0c23daa52c2372b475aa35f42062638e40f536656722a0efc4542100ce" exitCode=0 Jul 08 15:56:21.476281 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.476173 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"cfa34b0c23daa52c2372b475aa35f42062638e40f536656722a0efc4542100ce"} Jul 08 15:56:21.484065 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.484036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.654097 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.654002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.751983 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.751957 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.901170 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.901141 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:21.935317 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.935236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:21.935317 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:21.935276 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:21.935468 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:21.935376 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:56:21.935468 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:21.935430 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs podName:c7198ffb-8622-414a-8462-6537510922d4 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:53.935414923 +0000 UTC m=+66.213510758 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs") pod "network-metrics-daemon-58zvw" (UID: "c7198ffb-8622-414a-8462-6537510922d4") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 15:56:21.935468 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:21.935377 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 15:56:21.935569 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:21.935504 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret podName:c2c7f250-8d3c-41c8-95fa-fae62dbd4d51 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:53.935491874 +0000 UTC m=+66.213587713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret") pod "global-pull-secret-syncer-482z8" (UID: "c2c7f250-8d3c-41c8-95fa-fae62dbd4d51") : object "kube-system"/"original-pull-secret" not registered Jul 08 15:56:22.036072 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.036039 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:22.036229 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.036215 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 15:56:22.036265 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.036235 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 15:56:22.036265 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.036245 2558 projected.go:196] Error preparing data for projected volume kube-api-access-vqdtp for pod openshift-network-diagnostics/network-check-target-cx7b4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:56:22.036348 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.036306 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp podName:275776f6-6b71-4886-b4bd-5f2fdd863599 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:54.036293128 +0000 UTC m=+66.314388964 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqdtp" (UniqueName: "kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp") pod "network-check-target-cx7b4" (UID: "275776f6-6b71-4886-b4bd-5f2fdd863599") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 15:56:22.048315 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.048284 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:22.241444 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.241358 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:22.322850 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.322819 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:22.323011 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.322921 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:22.323011 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.322980 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:22.323191 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:22.323099 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:22.494738 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.494656 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:22.893419 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:22.893385 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:23.291823 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.291738 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:23.322644 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.322613 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:23.322807 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:23.322724 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:23.455475 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.455436 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:23.552260 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.552182 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:23.702337 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.702301 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:23.895598 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:23.895564 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:24.300421 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:24.300345 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:24.323075 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:24.322649 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:24.323075 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:24.322673 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:24.323075 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:24.322779 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:24.323360 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:24.323206 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:24.494572 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:24.494537 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:25.321909 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:25.321877 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:25.322305 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:25.321986 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:26.322177 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:26.322140 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:26.322649 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:26.322158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:26.322649 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:26.322286 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:26.322649 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:26.322321 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:27.142947 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:27.142915 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:27.211893 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:27.211857 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:27.322319 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:27.321958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:27.322319 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:27.322122 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:27.493513 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:27.493481 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerStarted","Data":"e532e8d74c01f8a99b131454a30f248d982a43f4771437510b4dd4ed7ac772b7"} Jul 08 15:56:28.323145 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:28.323110 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:28.323534 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:28.323200 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:28.323534 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:28.323215 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:28.323534 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:28.323304 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:28.498484 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:28.498454 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="e532e8d74c01f8a99b131454a30f248d982a43f4771437510b4dd4ed7ac772b7" exitCode=0 Jul 08 15:56:28.498635 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:28.498491 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"e532e8d74c01f8a99b131454a30f248d982a43f4771437510b4dd4ed7ac772b7"} Jul 08 15:56:29.230315 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.230276 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:29.322847 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.322811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:29.323019 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:29.322967 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:29.377380 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.377346 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:29.500357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.500261 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:29.503483 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.503456 2558 generic.go:356] "Generic (PLEG): container finished" podID="b2f55dfb-8b69-4985-b0c4-d256eca18e0b" containerID="dd972e29c498546c7603db45289c6ecbec2b0ef1d7a3233af5405dd1338700ad" exitCode=0 Jul 08 15:56:29.503618 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.503505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerDied","Data":"dd972e29c498546c7603db45289c6ecbec2b0ef1d7a3233af5405dd1338700ad"} Jul 08 15:56:29.603263 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:29.603094 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:30.201568 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.201537 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-482z8"] Jul 08 15:56:30.201801 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.201682 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:30.201801 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:30.201788 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:30.204178 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.204141 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58zvw"] Jul 08 15:56:30.204318 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.204239 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:30.204375 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:30.204324 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:30.216278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.216242 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cx7b4"] Jul 08 15:56:30.216428 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.216352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:30.216466 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:30.216426 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:30.509321 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.509288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" event={"ID":"b2f55dfb-8b69-4985-b0c4-d256eca18e0b","Type":"ContainerStarted","Data":"0b8d4d548ff10e3f20d1d7283e77abfc4e257d1ef67f05620cdb401d1f6a07c0"} Jul 08 15:56:30.536170 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.536120 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q2j7f" podStartSLOduration=9.615971395999999 podStartE2EDuration="42.536103745s" totalImagesPullingTime="32.920132349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:30.535950955 +0000 UTC m=+42.814046814" watchObservedRunningTime="2026-07-08 15:56:30.536103745 +0000 UTC m=+42.814199596" Jul 08 15:56:30.656118 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.656072 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:30.758203 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:30.758170 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:31.322533 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:31.322446 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:31.322683 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:31.322560 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:31.322683 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:31.322611 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:31.322766 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:31.322694 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:31.638622 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:31.638581 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:31.708992 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:31.708963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:32.322787 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:32.322757 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:32.322965 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:32.322865 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:32.571680 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:32.571644 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:32.646896 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:32.646856 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:32.713077 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:32.713045 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:32.983000 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:32.982929 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:33.083656 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:33.083622 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:33.322306 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:33.322218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:33.322477 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:33.322342 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-58zvw" podUID="c7198ffb-8622-414a-8462-6537510922d4" Jul 08 15:56:33.322477 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:33.322401 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:33.322591 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:33.322515 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cx7b4" podUID="275776f6-6b71-4886-b4bd-5f2fdd863599" Jul 08 15:56:34.278422 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.278390 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:34.322636 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.322601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:34.322789 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:34.322738 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-482z8" podUID="c2c7f250-8d3c-41c8-95fa-fae62dbd4d51" Jul 08 15:56:34.381579 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.381554 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:34.472617 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.472592 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-249.ec2.internal" event="NodeReady" Jul 08 15:56:34.472768 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.472716 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 15:56:34.528917 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.528843 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pdt2s"] Jul 08 15:56:34.551416 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.551390 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pklc7"] Jul 08 15:56:34.551567 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.551523 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.559837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.559818 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 15:56:34.559958 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.559857 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zrgc2\"" Jul 08 15:56:34.560123 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.560110 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 15:56:34.565144 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.565126 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdt2s"] Jul 08 15:56:34.565187 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.565163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pklc7"] Jul 08 15:56:34.565244 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.565233 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.568100 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.568071 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 15:56:34.569987 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.569970 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 15:56:34.570109 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.570075 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzfpn\"" Jul 08 15:56:34.571422 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.571199 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 15:56:34.625422 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efef9934-4ae2-4710-856e-ebda733aa46e-tmp-dir\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.625582 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625442 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vh6d\" (UniqueName: \"kubernetes.io/projected/efef9934-4ae2-4710-856e-ebda733aa46e-kube-api-access-6vh6d\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.625582 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625458 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b11d0df-d1a6-464b-8547-cf2be847cc3a-cert\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.625582 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsccm\" (UniqueName: \"kubernetes.io/projected/8b11d0df-d1a6-464b-8547-cf2be847cc3a-kube-api-access-fsccm\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.625582 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625548 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efef9934-4ae2-4710-856e-ebda733aa46e-metrics-tls\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.625582 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.625583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efef9934-4ae2-4710-856e-ebda733aa46e-config-volume\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.636065 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.636039 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g8lkv"] Jul 08 15:56:34.657410 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.657385 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.659873 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.659843 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8lkv"] Jul 08 15:56:34.660714 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.660696 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 15:56:34.660821 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.660713 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 15:56:34.660821 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.660732 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cqn8b\"" Jul 08 15:56:34.661140 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.661125 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 15:56:34.661140 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.661132 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 15:56:34.710725 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.710679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:34.726880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.726847 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5zsd\" (UniqueName: \"kubernetes.io/projected/57e1c730-2d02-4410-9816-ede39442e0a4-kube-api-access-w5zsd\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.726956 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.726888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1c730-2d02-4410-9816-ede39442e0a4-data-volume\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.726956 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.726907 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1c730-2d02-4410-9816-ede39442e0a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.727035 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.726965 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efef9934-4ae2-4710-856e-ebda733aa46e-config-volume\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.727071 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727025 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1c730-2d02-4410-9816-ede39442e0a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.727144 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efef9934-4ae2-4710-856e-ebda733aa46e-tmp-dir\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.727187 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vh6d\" (UniqueName: \"kubernetes.io/projected/efef9934-4ae2-4710-856e-ebda733aa46e-kube-api-access-6vh6d\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.727225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727194 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b11d0df-d1a6-464b-8547-cf2be847cc3a-cert\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.727225 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727219 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c730-2d02-4410-9816-ede39442e0a4-crio-socket\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.727296 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727238 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fsccm\" (UniqueName: \"kubernetes.io/projected/8b11d0df-d1a6-464b-8547-cf2be847cc3a-kube-api-access-fsccm\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.727296 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727271 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efef9934-4ae2-4710-856e-ebda733aa46e-metrics-tls\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.727494 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727472 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/efef9934-4ae2-4710-856e-ebda733aa46e-tmp-dir\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.727674 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.727658 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/efef9934-4ae2-4710-856e-ebda733aa46e-config-volume\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.731215 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.731062 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/efef9934-4ae2-4710-856e-ebda733aa46e-metrics-tls\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.731314 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.731119 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b11d0df-d1a6-464b-8547-cf2be847cc3a-cert\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.737983 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.737954 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsccm\" (UniqueName: \"kubernetes.io/projected/8b11d0df-d1a6-464b-8547-cf2be847cc3a-kube-api-access-fsccm\") pod \"ingress-canary-pklc7\" (UID: \"8b11d0df-d1a6-464b-8547-cf2be847cc3a\") " pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.738807 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.738790 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vh6d\" (UniqueName: \"kubernetes.io/projected/efef9934-4ae2-4710-856e-ebda733aa46e-kube-api-access-6vh6d\") pod \"dns-default-pdt2s\" (UID: \"efef9934-4ae2-4710-856e-ebda733aa46e\") " pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.826174 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.826060 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:34.828032 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828004 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1c730-2d02-4410-9816-ede39442e0a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828162 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c730-2d02-4410-9816-ede39442e0a4-crio-socket\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828162 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5zsd\" (UniqueName: \"kubernetes.io/projected/57e1c730-2d02-4410-9816-ede39442e0a4-kube-api-access-w5zsd\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828162 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828161 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1c730-2d02-4410-9816-ede39442e0a4-data-volume\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828339 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1c730-2d02-4410-9816-ede39442e0a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828339 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828291 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1c730-2d02-4410-9816-ede39442e0a4-crio-socket\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828539 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828519 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1c730-2d02-4410-9816-ede39442e0a4-data-volume\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.828721 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.828705 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1c730-2d02-4410-9816-ede39442e0a4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.830324 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.830304 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1c730-2d02-4410-9816-ede39442e0a4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.837943 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.837914 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5zsd\" (UniqueName: \"kubernetes.io/projected/57e1c730-2d02-4410-9816-ede39442e0a4-kube-api-access-w5zsd\") pod \"insights-runtime-extractor-g8lkv\" (UID: \"57e1c730-2d02-4410-9816-ede39442e0a4\") " pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:34.860942 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.860911 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:34.876067 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.876037 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pklc7" Jul 08 15:56:34.981932 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:34.981610 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g8lkv" Jul 08 15:56:35.085377 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.085346 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pdt2s"] Jul 08 15:56:35.089674 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.089390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pklc7"] Jul 08 15:56:35.089674 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:35.089604 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefef9934_4ae2_4710_856e_ebda733aa46e.slice/crio-55b1929427daa4df8af2d6887f3b78a7d360f70822cc3ba51693dec2155a9bb3 WatchSource:0}: Error finding container 55b1929427daa4df8af2d6887f3b78a7d360f70822cc3ba51693dec2155a9bb3: Status 404 returned error can't find the container with id 55b1929427daa4df8af2d6887f3b78a7d360f70822cc3ba51693dec2155a9bb3 Jul 08 15:56:35.093359 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:35.093329 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b11d0df_d1a6_464b_8547_cf2be847cc3a.slice/crio-74c7e61a10af3b4608ca625b7da6b27fa7cba5a21852d46f86bba87721148c7e WatchSource:0}: Error finding container 74c7e61a10af3b4608ca625b7da6b27fa7cba5a21852d46f86bba87721148c7e: Status 404 returned error can't find the container with id 74c7e61a10af3b4608ca625b7da6b27fa7cba5a21852d46f86bba87721148c7e Jul 08 15:56:35.093733 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.093690 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:35.142203 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.142171 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g8lkv"] Jul 08 15:56:35.145669 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:35.145634 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57e1c730_2d02_4410_9816_ede39442e0a4.slice/crio-29ac0c1be233c6afd4caadad45f8201e9e71f0f307cab31f98def77334f9aa60 WatchSource:0}: Error finding container 29ac0c1be233c6afd4caadad45f8201e9e71f0f307cab31f98def77334f9aa60: Status 404 returned error can't find the container with id 29ac0c1be233c6afd4caadad45f8201e9e71f0f307cab31f98def77334f9aa60 Jul 08 15:56:35.178570 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.178540 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:35.322244 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.322207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:35.322775 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.322390 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:35.327803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.327778 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 15:56:35.327803 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.327798 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-272kb\"" Jul 08 15:56:35.328064 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.327780 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 15:56:35.328064 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.327782 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tkqf\"" Jul 08 15:56:35.328361 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.328349 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 15:56:35.522880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.522849 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pklc7" event={"ID":"8b11d0df-d1a6-464b-8547-cf2be847cc3a","Type":"ContainerStarted","Data":"74c7e61a10af3b4608ca625b7da6b27fa7cba5a21852d46f86bba87721148c7e"} Jul 08 15:56:35.525916 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.524853 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdt2s" event={"ID":"efef9934-4ae2-4710-856e-ebda733aa46e","Type":"ContainerStarted","Data":"55b1929427daa4df8af2d6887f3b78a7d360f70822cc3ba51693dec2155a9bb3"} Jul 08 15:56:35.526867 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.526843 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8lkv" event={"ID":"57e1c730-2d02-4410-9816-ede39442e0a4","Type":"ContainerStarted","Data":"29ac0c1be233c6afd4caadad45f8201e9e71f0f307cab31f98def77334f9aa60"} Jul 08 15:56:35.953422 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:35.953389 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:36.033026 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:36.032991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:36.322791 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:36.322713 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:36.326407 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:36.326383 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 15:56:36.862523 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:36.862442 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:40.735223 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:40.735191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:40.837744 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:40.837710 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:41.544680 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.544429 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdt2s" event={"ID":"efef9934-4ae2-4710-856e-ebda733aa46e","Type":"ContainerStarted","Data":"eca622292d0933d4f0e1c3706b3c64bf123a129d3c2ad61205814ee695765518"} Jul 08 15:56:41.544851 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.544704 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:41.544851 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.544743 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pdt2s" event={"ID":"efef9934-4ae2-4710-856e-ebda733aa46e","Type":"ContainerStarted","Data":"46647c795755747c44a15506b016a58fa33791b2749e0568164299f6207dd7c8"} Jul 08 15:56:41.549007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.548973 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8lkv" event={"ID":"57e1c730-2d02-4410-9816-ede39442e0a4","Type":"ContainerStarted","Data":"76654e84b73d5f5d7b99a8c9f7ee195f8a8f0e1610e112784a918fd934540342"} Jul 08 15:56:41.550488 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.550467 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pklc7" event={"ID":"8b11d0df-d1a6-464b-8547-cf2be847cc3a","Type":"ContainerStarted","Data":"68b4500049e396977a30ec18292fe4b65c6511956e1c2baddd455f3578e3d37c"} Jul 08 15:56:41.566097 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.566040 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pdt2s" podStartSLOduration=1.524068014 podStartE2EDuration="7.566025136s" totalImagesPullingTime="6.041957122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:41.565897134 +0000 UTC m=+53.843992990" watchObservedRunningTime="2026-07-08 15:56:41.566025136 +0000 UTC m=+53.844120970" Jul 08 15:56:41.584657 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:41.584613 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pklc7" podStartSLOduration=1.538463299 podStartE2EDuration="7.584597942s" totalImagesPullingTime="6.046134643s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:41.584392236 +0000 UTC m=+53.862488109" watchObservedRunningTime="2026-07-08 15:56:41.584597942 +0000 UTC m=+53.862693799" Jul 08 15:56:42.555425 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:42.555392 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8lkv" event={"ID":"57e1c730-2d02-4410-9816-ede39442e0a4","Type":"ContainerStarted","Data":"4708c6d436e708566f80e1c114841eec6a90011335f353b69f23ee74c6fd29da"} Jul 08 15:56:43.035587 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:43.035338 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:43.137639 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:43.137608 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:44.733741 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:44.733706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:44.801576 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:44.801547 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:45.566658 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:45.566617 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g8lkv" event={"ID":"57e1c730-2d02-4410-9816-ede39442e0a4","Type":"ContainerStarted","Data":"e79ac9c636d1805230f4a92ae35912c6b29ec835415d506c1a1348018a27eb0a"} Jul 08 15:56:45.584917 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:45.584868 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g8lkv" podStartSLOduration=2.303600377 podStartE2EDuration="11.584852597s" totalImagesPullingTime="9.28125222s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:56:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:45.584387161 +0000 UTC m=+57.862483018" watchObservedRunningTime="2026-07-08 15:56:45.584852597 +0000 UTC m=+57.862948453" Jul 08 15:56:47.771752 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:47.771721 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:47.844960 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:47.844928 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:50.266884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:50.266857 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zzgqm" Jul 08 15:56:50.412229 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:50.412195 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:50.561871 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:50.561797 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:51.557341 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.557311 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pdt2s" Jul 08 15:56:51.785348 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.785318 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:56:51.788516 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.788494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.792243 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.792221 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 15:56:51.792512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.792493 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 15:56:51.792595 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.792572 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 15:56:51.793183 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.793166 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rlzx9\"" Jul 08 15:56:51.793183 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.793179 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 15:56:51.794044 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.794030 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 15:56:51.794154 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.794055 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 15:56:51.794154 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.794032 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 15:56:51.810397 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.810330 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:56:51.818567 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.818542 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:51.855517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855484 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.855664 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855529 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.855664 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855613 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.855664 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.855767 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855673 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.855767 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.855699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfck9\" (UniqueName: \"kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.904958 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.904925 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:51.956264 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956231 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.956443 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956289 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.956443 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956308 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.956443 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.956443 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956344 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfck9\" (UniqueName: \"kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.956443 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.956374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.957102 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.957054 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.957203 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.957118 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.957203 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.957127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.960207 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.960179 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.960305 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.960257 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:51.969008 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:51.968988 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfck9\" (UniqueName: \"kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9\") pod \"console-76848766c8-89w47\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:52.097372 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.097272 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:56:52.235976 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.235943 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:56:52.238791 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:52.238768 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee5ceb7_2eb3_46c7_92ad_9927fa996494.slice/crio-dcab5ba47c16acd39694294efc4e748d63e9c700fb09ebf9f55a7255e7d96d01 WatchSource:0}: Error finding container dcab5ba47c16acd39694294efc4e748d63e9c700fb09ebf9f55a7255e7d96d01: Status 404 returned error can't find the container with id dcab5ba47c16acd39694294efc4e748d63e9c700fb09ebf9f55a7255e7d96d01 Jul 08 15:56:52.400180 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.400153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:52.504743 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.504706 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:52.591346 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.591315 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76848766c8-89w47" event={"ID":"8ee5ceb7-2eb3-46c7-92ad-9927fa996494","Type":"ContainerStarted","Data":"dcab5ba47c16acd39694294efc4e748d63e9c700fb09ebf9f55a7255e7d96d01"} Jul 08 15:56:52.660626 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.660545 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:52.758991 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.758958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:52.869412 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:52.869379 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:53.340352 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.340309 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:53.442548 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.442504 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:53.518806 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.518772 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:56:53.520773 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.520759 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.531871 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.531850 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 15:56:53.539136 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.539111 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:56:53.568384 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568352 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568384 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568383 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568405 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlpjw\" (UniqueName: \"kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568465 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568540 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.568628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.568586 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.669964 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.669923 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.669987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670013 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670100 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670173 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670485 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlpjw\" (UniqueName: \"kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.670963 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.670936 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.671414 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.671389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.671528 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.671395 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.671870 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.671846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.672860 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.672833 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.673050 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.673030 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.681281 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.681254 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlpjw\" (UniqueName: \"kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw\") pod \"console-7646c458f6-vqq22\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.829356 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.829319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:56:53.973306 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.973224 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:56:53.973558 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.973537 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:53.973680 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.973664 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:53.976869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.976840 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 15:56:53.977602 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:53.977581 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77a64ff5_ea7a_4ab8_bb8d_814bf883eaa5.slice/crio-0d3f9863dd9a30acb6271cefc5b09c7a1d76fb277cd08bd72507306f691969ef WatchSource:0}: Error finding container 0d3f9863dd9a30acb6271cefc5b09c7a1d76fb277cd08bd72507306f691969ef: Status 404 returned error can't find the container with id 0d3f9863dd9a30acb6271cefc5b09c7a1d76fb277cd08bd72507306f691969ef Jul 08 15:56:53.978566 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.978543 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 15:56:53.986387 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.986361 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c2c7f250-8d3c-41c8-95fa-fae62dbd4d51-original-pull-secret\") pod \"global-pull-secret-syncer-482z8\" (UID: \"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51\") " pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:53.986491 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:53.986389 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7198ffb-8622-414a-8462-6537510922d4-metrics-certs\") pod \"network-metrics-daemon-58zvw\" (UID: \"c7198ffb-8622-414a-8462-6537510922d4\") " pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:54.036441 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.036400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-482z8" Jul 08 15:56:54.074240 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.074207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:54.077940 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.077919 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 15:56:54.088188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.088156 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 15:56:54.097876 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.097843 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdtp\" (UniqueName: \"kubernetes.io/projected/275776f6-6b71-4886-b4bd-5f2fdd863599-kube-api-access-vqdtp\") pod \"network-check-target-cx7b4\" (UID: \"275776f6-6b71-4886-b4bd-5f2fdd863599\") " pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:54.162559 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.162535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-482z8"] Jul 08 15:56:54.165201 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:54.165160 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2c7f250_8d3c_41c8_95fa_fae62dbd4d51.slice/crio-bcbce4c6a439285a0840c0d0c84abc321ef5310339ac5931a25b664d70ed43df WatchSource:0}: Error finding container bcbce4c6a439285a0840c0d0c84abc321ef5310339ac5931a25b664d70ed43df: Status 404 returned error can't find the container with id bcbce4c6a439285a0840c0d0c84abc321ef5310339ac5931a25b664d70ed43df Jul 08 15:56:54.235427 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.235346 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-272kb\"" Jul 08 15:56:54.241049 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.241027 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7tkqf\"" Jul 08 15:56:54.243047 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.243027 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-58zvw" Jul 08 15:56:54.247657 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.247633 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:56:54.328049 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.328003 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:54.402075 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.402045 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-58zvw"] Jul 08 15:56:54.405223 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:54.405194 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7198ffb_8622_414a_8462_6537510922d4.slice/crio-f063a4206eff5cb6cb8fa79bf07414e64ce0c0dc6267351a6c5e720c6520691e WatchSource:0}: Error finding container f063a4206eff5cb6cb8fa79bf07414e64ce0c0dc6267351a6c5e720c6520691e: Status 404 returned error can't find the container with id f063a4206eff5cb6cb8fa79bf07414e64ce0c0dc6267351a6c5e720c6520691e Jul 08 15:56:54.417235 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.417211 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cx7b4"] Jul 08 15:56:54.419493 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:54.419462 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275776f6_6b71_4886_b4bd_5f2fdd863599.slice/crio-c7f932943b4ddd874ca2c8268cb9d3a5abdb4d2d11ecf63ec072327c1943a805 WatchSource:0}: Error finding container c7f932943b4ddd874ca2c8268cb9d3a5abdb4d2d11ecf63ec072327c1943a805: Status 404 returned error can't find the container with id c7f932943b4ddd874ca2c8268cb9d3a5abdb4d2d11ecf63ec072327c1943a805 Jul 08 15:56:54.451804 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.451772 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:54.575892 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.575802 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:54.585196 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.585166 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22"] Jul 08 15:56:54.587552 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.587530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:54.590900 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.590880 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 08 15:56:54.591026 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.590904 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fctrt\"" Jul 08 15:56:54.599537 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.599478 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7646c458f6-vqq22" event={"ID":"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5","Type":"ContainerStarted","Data":"0d3f9863dd9a30acb6271cefc5b09c7a1d76fb277cd08bd72507306f691969ef"} Jul 08 15:56:54.601775 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.601752 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22"] Jul 08 15:56:54.602310 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.602284 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58zvw" event={"ID":"c7198ffb-8622-414a-8462-6537510922d4","Type":"ContainerStarted","Data":"f063a4206eff5cb6cb8fa79bf07414e64ce0c0dc6267351a6c5e720c6520691e"} Jul 08 15:56:54.604045 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.603975 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cx7b4" event={"ID":"275776f6-6b71-4886-b4bd-5f2fdd863599","Type":"ContainerStarted","Data":"c7f932943b4ddd874ca2c8268cb9d3a5abdb4d2d11ecf63ec072327c1943a805"} Jul 08 15:56:54.605606 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.605575 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-482z8" event={"ID":"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51","Type":"ContainerStarted","Data":"bcbce4c6a439285a0840c0d0c84abc321ef5310339ac5931a25b664d70ed43df"} Jul 08 15:56:54.679508 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.679466 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vrx22\" (UID: \"c6b7b55b-240b-4cbc-b4f3-157633d5d031\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:54.780460 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.780416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vrx22\" (UID: \"c6b7b55b-240b-4cbc-b4f3-157633d5d031\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:54.780640 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:54.780554 2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 08 15:56:54.780640 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:56:54.780631 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates podName:c6b7b55b-240b-4cbc-b4f3-157633d5d031 nodeName:}" failed. No retries permitted until 2026-07-08 15:56:55.280607181 +0000 UTC m=+67.558703016 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-vrx22" (UID: "c6b7b55b-240b-4cbc-b4f3-157633d5d031") : secret "prometheus-operator-admission-webhook-tls" not found Jul 08 15:56:54.884326 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:54.884295 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:55.284304 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:55.284222 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vrx22\" (UID: \"c6b7b55b-240b-4cbc-b4f3-157633d5d031\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:55.287344 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:55.287288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c6b7b55b-240b-4cbc-b4f3-157633d5d031-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-vrx22\" (UID: \"c6b7b55b-240b-4cbc-b4f3-157633d5d031\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:55.500756 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:55.500716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:55.843074 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:55.843014 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22"] Jul 08 15:56:55.850561 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:56:55.850514 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6b7b55b_240b_4cbc_b4f3_157633d5d031.slice/crio-158d1f623656141547e226b49ccbd0e8a6c37817614c2c8085cf0271d39bc5ec WatchSource:0}: Error finding container 158d1f623656141547e226b49ccbd0e8a6c37817614c2c8085cf0271d39bc5ec: Status 404 returned error can't find the container with id 158d1f623656141547e226b49ccbd0e8a6c37817614c2c8085cf0271d39bc5ec Jul 08 15:56:56.614650 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.614618 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76848766c8-89w47" event={"ID":"8ee5ceb7-2eb3-46c7-92ad-9927fa996494","Type":"ContainerStarted","Data":"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6"} Jul 08 15:56:56.617039 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.617007 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7646c458f6-vqq22" event={"ID":"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5","Type":"ContainerStarted","Data":"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d"} Jul 08 15:56:56.619015 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.618991 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" event={"ID":"c6b7b55b-240b-4cbc-b4f3-157633d5d031","Type":"ContainerStarted","Data":"158d1f623656141547e226b49ccbd0e8a6c37817614c2c8085cf0271d39bc5ec"} Jul 08 15:56:56.639979 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.639923 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76848766c8-89w47" podStartSLOduration=2.163124966 podStartE2EDuration="5.639904968s" totalImagesPullingTime="3.476780002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:56.638886347 +0000 UTC m=+68.916982224" watchObservedRunningTime="2026-07-08 15:56:56.639904968 +0000 UTC m=+68.918000829" Jul 08 15:56:56.664835 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.664779 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7646c458f6-vqq22" podStartSLOduration=1.895719332 podStartE2EDuration="3.66476316s" totalImagesPullingTime="1.769043828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:56.663550054 +0000 UTC m=+68.941645910" watchObservedRunningTime="2026-07-08 15:56:56.66476316 +0000 UTC m=+68.942859017" Jul 08 15:56:56.864891 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.864850 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:56.928241 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:56.928191 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:57.624660 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.624567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:57.626578 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.626547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58zvw" event={"ID":"c7198ffb-8622-414a-8462-6537510922d4","Type":"ContainerStarted","Data":"777c2563fde4bb99f0bd13ded14e8e28a65e083ce3ab48fa34386ed3d24aa3fa"} Jul 08 15:56:57.626710 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.626614 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-58zvw" event={"ID":"c7198ffb-8622-414a-8462-6537510922d4","Type":"ContainerStarted","Data":"c18aec38ecb51bb66bcf6f2c17db03e8ce92f18fd9d5b249cb31eaa0aa490a8d"} Jul 08 15:56:57.628624 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.628597 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" event={"ID":"c6b7b55b-240b-4cbc-b4f3-157633d5d031","Type":"ContainerStarted","Data":"f2c270d44e24f9aebd9aa902e04b2ca757ce95706dcd58eca939c1937d227da6"} Jul 08 15:56:57.665442 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.664986 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" podStartSLOduration=2.026191047 podStartE2EDuration="3.664962684s" totalImagesPullingTime="1.638771637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:57.663784471 +0000 UTC m=+69.941880358" watchObservedRunningTime="2026-07-08 15:56:57.664962684 +0000 UTC m=+69.943058542" Jul 08 15:56:57.665442 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.665299 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-58zvw" podStartSLOduration=67.489708793 podStartE2EDuration="1m9.665286029s" totalImagesPullingTime="2.175577236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:56:57.647353631 +0000 UTC m=+69.925449507" watchObservedRunningTime="2026-07-08 15:56:57.665286029 +0000 UTC m=+69.943381887" Jul 08 15:56:57.721953 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.721911 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:57.823645 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.823549 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:57.924716 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:57.924677 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:58.632838 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:58.632810 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:58.638408 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:58.638382 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-vrx22" Jul 08 15:56:59.650880 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.650846 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:59.698653 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.698622 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9d489"] Jul 08 15:56:59.718746 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.718718 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9d489"] Jul 08 15:56:59.718939 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.718839 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.724851 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.724825 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 08 15:56:59.726298 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.726235 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 15:56:59.726298 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.726279 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 15:56:59.726465 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.726323 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 08 15:56:59.726764 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.726742 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zxtrl\"" Jul 08 15:56:59.727132 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.726981 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 15:56:59.760590 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.760555 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:59.823750 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.823710 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.823920 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.823764 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7788f1-1248-4ff1-b107-6ba0997d2982-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.823920 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.823796 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rwf5\" (UniqueName: \"kubernetes.io/projected/da7788f1-1248-4ff1-b107-6ba0997d2982-kube-api-access-5rwf5\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.823920 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.823890 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.903010 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.902918 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:56:59.924982 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.924948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rwf5\" (UniqueName: \"kubernetes.io/projected/da7788f1-1248-4ff1-b107-6ba0997d2982-kube-api-access-5rwf5\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.925193 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.925027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.925193 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.925099 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.925193 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.925133 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7788f1-1248-4ff1-b107-6ba0997d2982-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.925917 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.925889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da7788f1-1248-4ff1-b107-6ba0997d2982-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.927851 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.927814 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.927962 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.927890 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/da7788f1-1248-4ff1-b107-6ba0997d2982-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:56:59.935575 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:56:59.935542 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rwf5\" (UniqueName: \"kubernetes.io/projected/da7788f1-1248-4ff1-b107-6ba0997d2982-kube-api-access-5rwf5\") pod \"prometheus-operator-567f7b8b7c-9d489\" (UID: \"da7788f1-1248-4ff1-b107-6ba0997d2982\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:57:00.030635 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:00.030601 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" Jul 08 15:57:00.792195 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:00.792170 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-9d489"] Jul 08 15:57:00.795248 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:00.795226 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda7788f1_1248_4ff1_b107_6ba0997d2982.slice/crio-d5b2571329adffdf39fd203c462d360e8e0c89fc3bd85895117b3f62b42523a6 WatchSource:0}: Error finding container d5b2571329adffdf39fd203c462d360e8e0c89fc3bd85895117b3f62b42523a6: Status 404 returned error can't find the container with id d5b2571329adffdf39fd203c462d360e8e0c89fc3bd85895117b3f62b42523a6 Jul 08 15:57:01.629332 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.629299 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:01.644837 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.644806 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" event={"ID":"da7788f1-1248-4ff1-b107-6ba0997d2982","Type":"ContainerStarted","Data":"d5b2571329adffdf39fd203c462d360e8e0c89fc3bd85895117b3f62b42523a6"} Jul 08 15:57:01.646499 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.646474 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cx7b4" event={"ID":"275776f6-6b71-4886-b4bd-5f2fdd863599","Type":"ContainerStarted","Data":"3d4d7bdb940361a82bc493bd753e1cd648d38d46b47a5e69bcf11bffd2630f8b"} Jul 08 15:57:01.646636 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.646561 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:57:01.648224 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.648203 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-482z8" event={"ID":"c2c7f250-8d3c-41c8-95fa-fae62dbd4d51","Type":"ContainerStarted","Data":"6cb13e2c4693d8990ac903af31ea52b31521b756dc337ce70dc4068c07df1256"} Jul 08 15:57:01.676051 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.675999 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cx7b4" podStartSLOduration=67.455722656 podStartE2EDuration="1m13.675980876s" totalImagesPullingTime="6.22025822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:01.675292675 +0000 UTC m=+73.953388532" watchObservedRunningTime="2026-07-08 15:57:01.675980876 +0000 UTC m=+73.954076733" Jul 08 15:57:01.742531 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:01.742496 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:02.098141 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.098036 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:02.098141 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.098120 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:02.103357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.103331 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:02.147154 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.147101 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-482z8" podStartSLOduration=67.660030611 podStartE2EDuration="1m14.147062214s" totalImagesPullingTime="6.487031603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 15:55:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:01.704974118 +0000 UTC m=+73.983070000" watchObservedRunningTime="2026-07-08 15:57:02.147062214 +0000 UTC m=+74.425158072" Jul 08 15:57:02.523482 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.523450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:02.653441 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.653401 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" event={"ID":"da7788f1-1248-4ff1-b107-6ba0997d2982","Type":"ContainerStarted","Data":"c0c81cb5f7bb9314b061bf7fe483af803c2d130eda630b1484fac24b4652a658"} Jul 08 15:57:02.653644 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.653461 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" event={"ID":"da7788f1-1248-4ff1-b107-6ba0997d2982","Type":"ContainerStarted","Data":"d3d76c9d7201d3731850130e7b6876da75cbc57c616d48b70a8515da3744366d"} Jul 08 15:57:02.658459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.658435 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:02.680389 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.680338 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-9d489" podStartSLOduration=2.282806646 podStartE2EDuration="3.680320568s" totalImagesPullingTime="1.397513922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:56:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:02.679110389 +0000 UTC m=+74.957206262" watchObservedRunningTime="2026-07-08 15:57:02.680320568 +0000 UTC m=+74.958416425" Jul 08 15:57:02.834310 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.834211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:02.935321 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:02.935290 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:03.829919 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:03.829885 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:03.830329 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:03.829953 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:03.834898 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:03.834875 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:03.835541 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:03.835519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:03.939593 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:03.939556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:04.663574 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:04.663546 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:04.729855 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:04.729816 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:57:05.060950 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.060873 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.237413 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.237378 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.414531 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.414494 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.567700 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.567671 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699"] Jul 08 15:57:05.569935 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.569919 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.573243 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.573220 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 08 15:57:05.573243 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.573233 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 08 15:57:05.573405 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.573256 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-fcc5c\"" Jul 08 15:57:05.574579 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.574530 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.587246 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.587221 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699"] Jul 08 15:57:05.596384 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.596365 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw"] Jul 08 15:57:05.598378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.598358 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.600229 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.600211 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5wwpn"] Jul 08 15:57:05.601543 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.601525 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 15:57:05.601649 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.601633 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 15:57:05.601713 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.601646 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hh7qp\"" Jul 08 15:57:05.601902 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.601889 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 15:57:05.602318 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.602306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.607255 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.607237 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 15:57:05.607349 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.607258 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 15:57:05.607691 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.607676 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cf48k\"" Jul 08 15:57:05.608431 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.608413 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 15:57:05.615906 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.615887 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw"] Jul 08 15:57:05.672181 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-sys\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672181 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672129 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrgz\" (UniqueName: \"kubernetes.io/projected/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-api-access-cqrgz\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.672181 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672150 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672259 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a1e6b6-1f53-4252-99f0-7f9afefce312-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wblx\" (UniqueName: \"kubernetes.io/projected/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-kube-api-access-5wblx\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672302 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-textfile\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672318 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672363 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-wtmp\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672420 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-root\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672494 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-metrics-client-ca\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672551 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-tls\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672583 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r8n2\" (UniqueName: \"kubernetes.io/projected/a5d42a09-65da-4767-be92-2f95f8e36820-kube-api-access-8r8n2\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.672643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672618 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.672927 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.672649 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.679363 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.679339 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.773362 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773331 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-sys\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773509 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773369 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrgz\" (UniqueName: \"kubernetes.io/projected/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-api-access-cqrgz\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.773509 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773433 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773509 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-sys\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.773651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773556 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a1e6b6-1f53-4252-99f0-7f9afefce312-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.773651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773604 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wblx\" (UniqueName: \"kubernetes.io/projected/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-kube-api-access-5wblx\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.773651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-textfile\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773864 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.773864 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773716 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-wtmp\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773864 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773746 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.773864 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773790 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-root\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.773864 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773840 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773867 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773895 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-metrics-client-ca\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773910 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-wtmp\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773957 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773977 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d9a1e6b6-1f53-4252-99f0-7f9afefce312-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.773982 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-tls\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774026 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r8n2\" (UniqueName: \"kubernetes.io/projected/a5d42a09-65da-4767-be92-2f95f8e36820-kube-api-access-8r8n2\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774058 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.774200 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774161 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-textfile\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.774721 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774409 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.774806 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774785 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.775016 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.774991 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-metrics-client-ca\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.775490 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.775463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.775642 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.775620 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a5d42a09-65da-4767-be92-2f95f8e36820-root\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.775788 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.775564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-accelerators-collector-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.776551 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.776528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-tls\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.776551 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.776528 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5d42a09-65da-4767-be92-2f95f8e36820-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.776725 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.776531 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.777319 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.777298 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.777387 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.777370 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.777538 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.777518 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.782159 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.782138 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.783658 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.783635 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrgz\" (UniqueName: \"kubernetes.io/projected/d9a1e6b6-1f53-4252-99f0-7f9afefce312-kube-api-access-cqrgz\") pod \"kube-state-metrics-7c9dbb8b7d-z5djw\" (UID: \"d9a1e6b6-1f53-4252-99f0-7f9afefce312\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.784287 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.784267 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wblx\" (UniqueName: \"kubernetes.io/projected/b38a0028-66d2-4906-a0c2-8efa6e7c6dc9-kube-api-access-5wblx\") pod \"openshift-state-metrics-54cf96dfcf-f8699\" (UID: \"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.784471 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.784451 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r8n2\" (UniqueName: \"kubernetes.io/projected/a5d42a09-65da-4767-be92-2f95f8e36820-kube-api-access-8r8n2\") pod \"node-exporter-5wwpn\" (UID: \"a5d42a09-65da-4767-be92-2f95f8e36820\") " pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.878976 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.878920 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" Jul 08 15:57:05.880465 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.880438 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:05.908706 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.908678 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" Jul 08 15:57:05.913631 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:05.913610 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5wwpn" Jul 08 15:57:05.925719 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:05.925686 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d42a09_65da_4767_be92_2f95f8e36820.slice/crio-386bde3c1aa0e38b458ab64a73fce7c86df67b1ed57deda16573c553567a6516 WatchSource:0}: Error finding container 386bde3c1aa0e38b458ab64a73fce7c86df67b1ed57deda16573c553567a6516: Status 404 returned error can't find the container with id 386bde3c1aa0e38b458ab64a73fce7c86df67b1ed57deda16573c553567a6516 Jul 08 15:57:06.045794 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.045765 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699"] Jul 08 15:57:06.047166 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:06.047143 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb38a0028_66d2_4906_a0c2_8efa6e7c6dc9.slice/crio-dc0a9ea254027cd4b9b500b34b8144e7a686ee4dc8adee055c0b7b0bc64170e2 WatchSource:0}: Error finding container dc0a9ea254027cd4b9b500b34b8144e7a686ee4dc8adee055c0b7b0bc64170e2: Status 404 returned error can't find the container with id dc0a9ea254027cd4b9b500b34b8144e7a686ee4dc8adee055c0b7b0bc64170e2 Jul 08 15:57:06.070830 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.070808 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.081925 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.081904 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw"] Jul 08 15:57:06.082980 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:06.082960 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9a1e6b6_1f53_4252_99f0_7f9afefce312.slice/crio-45db60d0542ef677095995b8fcd8ca64543e882645d2c40f68804fed8f77071c WatchSource:0}: Error finding container 45db60d0542ef677095995b8fcd8ca64543e882645d2c40f68804fed8f77071c: Status 404 returned error can't find the container with id 45db60d0542ef677095995b8fcd8ca64543e882645d2c40f68804fed8f77071c Jul 08 15:57:06.259623 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.259519 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.369492 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.369462 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.395532 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.395505 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:57:06.398154 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.398136 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.404793 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.404766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 08 15:57:06.404910 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.404767 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 08 15:57:06.404910 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.404791 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 08 15:57:06.405047 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.405030 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-qv4zs\"" Jul 08 15:57:06.405357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.405337 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 08 15:57:06.405437 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.405402 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 08 15:57:06.405564 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.405551 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 08 15:57:06.405696 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.405683 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 08 15:57:06.406046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.406034 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 08 15:57:06.406353 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.406341 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 08 15:57:06.424853 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.424819 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:57:06.480692 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480665 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480692 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480695 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480724 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480744 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480768 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-config-volume\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480802 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.480884 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480839 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-web-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480894 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-config-out\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480914 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480934 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.480984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzl68\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-kube-api-access-fzl68\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.481046 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.481003 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.494306 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.494275 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.582039 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.581945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-config-volume\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582039 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.581996 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582285 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582229 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-web-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582341 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582286 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-config-out\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582412 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582471 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582425 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582471 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582465 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582570 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582498 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzl68\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-kube-api-access-fzl68\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582570 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582525 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582677 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582615 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582677 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582650 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582774 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582689 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.582774 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.582722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.583308 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.583278 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.583436 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.583393 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.583577 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.583554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.585680 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.585656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-web-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.586024 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.585994 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-config-volume\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.586242 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.586216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.586387 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.586362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.586465 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.586362 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.586515 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.586463 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/860a9cf8-7b2d-4f13-b940-b037d560203d-config-out\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.587284 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.587265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.587414 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.587400 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.587622 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.587600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/860a9cf8-7b2d-4f13-b940-b037d560203d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.594947 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.594924 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzl68\" (UniqueName: \"kubernetes.io/projected/860a9cf8-7b2d-4f13-b940-b037d560203d-kube-api-access-fzl68\") pod \"alertmanager-main-0\" (UID: \"860a9cf8-7b2d-4f13-b940-b037d560203d\") " pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.668862 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.668825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" event={"ID":"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9","Type":"ContainerStarted","Data":"f3d3dafd3e32f7d3b6f94b7b99db8ebaf9b60417c023a900593121c2cff14589"} Jul 08 15:57:06.669043 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.668900 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" event={"ID":"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9","Type":"ContainerStarted","Data":"2d72f198155c43e47510d53781f24dde6fc838a7a194c1209fd452dfad7b058c"} Jul 08 15:57:06.669043 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.668928 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" event={"ID":"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9","Type":"ContainerStarted","Data":"dc0a9ea254027cd4b9b500b34b8144e7a686ee4dc8adee055c0b7b0bc64170e2"} Jul 08 15:57:06.670221 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.670187 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwpn" event={"ID":"a5d42a09-65da-4767-be92-2f95f8e36820","Type":"ContainerStarted","Data":"386bde3c1aa0e38b458ab64a73fce7c86df67b1ed57deda16573c553567a6516"} Jul 08 15:57:06.671491 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.671460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" event={"ID":"d9a1e6b6-1f53-4252-99f0-7f9afefce312","Type":"ContainerStarted","Data":"45db60d0542ef677095995b8fcd8ca64543e882645d2c40f68804fed8f77071c"} Jul 08 15:57:06.707450 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.707393 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 08 15:57:06.707621 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.707564 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.801667 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.801630 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:06.872560 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:06.872526 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 08 15:57:07.004522 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:07.004493 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod860a9cf8_7b2d_4f13_b940_b037d560203d.slice/crio-77fdc663d63dafae1efa00df0edfc264c9a9586ba6dd4e5ded8c39668f0c26a5 WatchSource:0}: Error finding container 77fdc663d63dafae1efa00df0edfc264c9a9586ba6dd4e5ded8c39668f0c26a5: Status 404 returned error can't find the container with id 77fdc663d63dafae1efa00df0edfc264c9a9586ba6dd4e5ded8c39668f0c26a5 Jul 08 15:57:07.676747 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:07.676715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" event={"ID":"b38a0028-66d2-4906-a0c2-8efa6e7c6dc9","Type":"ContainerStarted","Data":"a58cf86c58d6af3b027c92e644dd5e6425dc596ceb5359e2b20842208443eaec"} Jul 08 15:57:07.677978 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:07.677953 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"77fdc663d63dafae1efa00df0edfc264c9a9586ba6dd4e5ded8c39668f0c26a5"} Jul 08 15:57:07.679477 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:07.679454 2558 generic.go:356] "Generic (PLEG): container finished" podID="a5d42a09-65da-4767-be92-2f95f8e36820" containerID="877ceba393f6033e7f860cc6f622d248f98d84af59f25f9ef77eb9716ba823cc" exitCode=0 Jul 08 15:57:07.679564 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:07.679510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwpn" event={"ID":"a5d42a09-65da-4767-be92-2f95f8e36820","Type":"ContainerDied","Data":"877ceba393f6033e7f860cc6f622d248f98d84af59f25f9ef77eb9716ba823cc"} Jul 08 15:57:07.698901 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:07.698851 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-f8699" podStartSLOduration=1.590987683 podStartE2EDuration="2.698831681s" totalImagesPullingTime="1.107843998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:07.697100651 +0000 UTC m=+79.975196521" watchObservedRunningTime="2026-07-08 15:57:07.698831681 +0000 UTC m=+79.976927539" Jul 08 15:57:08.210526 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.210480 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:08.312295 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.312258 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:08.406074 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.406030 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:08.686662 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.686629 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwpn" event={"ID":"a5d42a09-65da-4767-be92-2f95f8e36820","Type":"ContainerStarted","Data":"c0d1f2b3b7054f0e061ed2d1694b1b8f18821d3840a9b4b0fdf4f109ef35d69a"} Jul 08 15:57:08.687121 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.686681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5wwpn" event={"ID":"a5d42a09-65da-4767-be92-2f95f8e36820","Type":"ContainerStarted","Data":"87438f2efb4f5ff5a2333eb987ed53e76c56d21a1bfc06bba9b04597a5603601"} Jul 08 15:57:08.688980 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.688954 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" event={"ID":"d9a1e6b6-1f53-4252-99f0-7f9afefce312","Type":"ContainerStarted","Data":"03b9271578782e5240a2e19a8bacf4fa6c41da2e6ba1aa7aff29e44e54baf528"} Jul 08 15:57:08.689112 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.689009 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" event={"ID":"d9a1e6b6-1f53-4252-99f0-7f9afefce312","Type":"ContainerStarted","Data":"a73036271fcafb8c870f67c12e7007f68fa9d268e1d886bb60ff15bbd2e39e09"} Jul 08 15:57:08.689112 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.689034 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" event={"ID":"d9a1e6b6-1f53-4252-99f0-7f9afefce312","Type":"ContainerStarted","Data":"12511cda7bab8e402d0b6c72d7ca078201dc58fec9c3a482c297287a66786e46"} Jul 08 15:57:08.690746 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.690725 2558 generic.go:356] "Generic (PLEG): container finished" podID="860a9cf8-7b2d-4f13-b940-b037d560203d" containerID="ba576fbe6e62706ff8ec03fb3e74bbd50d5deb593cb5c3c9c074ddf5ce540723" exitCode=0 Jul 08 15:57:08.690834 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.690797 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerDied","Data":"ba576fbe6e62706ff8ec03fb3e74bbd50d5deb593cb5c3c9c074ddf5ce540723"} Jul 08 15:57:08.719112 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.719050 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5wwpn" podStartSLOduration=2.33313871 podStartE2EDuration="3.719035113s" totalImagesPullingTime="1.31086091s" totalInitContainerRuntime="75.035493ms" isStatefulPod=true podCreationTimestamp="2026-07-08 15:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:08.718589731 +0000 UTC m=+80.996685589" watchObservedRunningTime="2026-07-08 15:57:08.719035113 +0000 UTC m=+80.997131004" Jul 08 15:57:08.744976 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:08.744918 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-z5djw" podStartSLOduration=1.464820107 podStartE2EDuration="3.744896887s" totalImagesPullingTime="2.28007678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:08.74311902 +0000 UTC m=+81.021214875" watchObservedRunningTime="2026-07-08 15:57:08.744896887 +0000 UTC m=+81.022992745" Jul 08 15:57:09.957318 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.957287 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-75dfd6d966-xttqf"] Jul 08 15:57:09.959683 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.959663 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:09.963844 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.963817 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 08 15:57:09.964123 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.964105 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-duj0nq319574o\"" Jul 08 15:57:09.965459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.965165 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 08 15:57:09.965459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.965271 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 08 15:57:09.965459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.965311 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-fhzp5\"" Jul 08 15:57:09.965459 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:09.965377 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 08 15:57:10.017960 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.017931 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75dfd6d966-xttqf"] Jul 08 15:57:10.060490 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.060455 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:57:10.062986 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.062958 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.107293 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.107263 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:10.114421 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114373 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-client-certs\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114421 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114423 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114703 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fvm\" (UniqueName: \"kubernetes.io/projected/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-kube-api-access-98fvm\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114703 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114560 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-metrics-server-audit-profiles\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114703 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114633 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-client-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114703 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-tls\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.114928 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.114739 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-audit-log\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.116560 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.116523 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:57:10.215480 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.215480 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215449 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-metrics-server-audit-profiles\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.215480 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.215757 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215532 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-client-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.215757 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215562 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-tls\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.215757 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.215757 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-audit-log\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.215757 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215646 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-client-certs\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215850 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h9xg\" (UniqueName: \"kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215891 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215918 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.216007 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.215947 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fvm\" (UniqueName: \"kubernetes.io/projected/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-kube-api-access-98fvm\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.216933 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.216625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-metrics-server-audit-profiles\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.216933 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.216656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-audit-log\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.216933 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.216873 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.218442 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.218420 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-tls\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.218655 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.218631 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-client-ca-bundle\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.219101 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.219065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-secret-metrics-server-client-certs\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.231239 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.231213 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fvm\" (UniqueName: \"kubernetes.io/projected/e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73-kube-api-access-98fvm\") pod \"metrics-server-75dfd6d966-xttqf\" (UID: \"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73\") " pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.270226 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.270194 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:10.285598 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.285565 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:10.316328 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316437 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316437 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316367 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316437 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316437 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316431 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316454 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.316643 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.316493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4h9xg\" (UniqueName: \"kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.317301 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.317246 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.317408 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.317372 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.317535 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.317513 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.317597 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.317538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.320788 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.320775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.325231 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.324625 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.329627 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.329450 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h9xg\" (UniqueName: \"kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg\") pod \"console-5fb8c4765d-lxk5q\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.373614 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.373288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:10.428030 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.428002 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-75dfd6d966-xttqf"] Jul 08 15:57:10.432444 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:10.432408 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0aa8a7d_8e5c_46ef_9982_5fdd516ffb73.slice/crio-dfa0db1575aef7082796fa4d3696735ee2edd82fa90ae621493eea537459ce0a WatchSource:0}: Error finding container dfa0db1575aef7082796fa4d3696735ee2edd82fa90ae621493eea537459ce0a: Status 404 returned error can't find the container with id dfa0db1575aef7082796fa4d3696735ee2edd82fa90ae621493eea537459ce0a Jul 08 15:57:10.573058 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.573032 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:57:10.576450 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:57:10.576424 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeafd55fe_bfdc_4fc5_8556_8c7e4d29f09e.slice/crio-03775b695613badcc411c5aefe256f5bc5489fd479ac474c45efdd5d2e73f13b WatchSource:0}: Error finding container 03775b695613badcc411c5aefe256f5bc5489fd479ac474c45efdd5d2e73f13b: Status 404 returned error can't find the container with id 03775b695613badcc411c5aefe256f5bc5489fd479ac474c45efdd5d2e73f13b Jul 08 15:57:10.703515 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.703480 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"4537897ab4592af2ab14774be5f98e4a506396a66e616043e0debaee8302333f"} Jul 08 15:57:10.703661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.703556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"b656b1868a5d6a9e882c59ff7c65e17a6458750cf0b3de3a7407533c082e90a0"} Jul 08 15:57:10.703661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.703595 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"dec6c9ca2d7b86d25a94d7b77b60ad9e21a707be19d24e029a0f8cb98a6ecfa0"} Jul 08 15:57:10.703661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.703626 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"49ccdd9d31c40d81e60a3f47c6112714f314c609580c8451aad2f01b6c86f38a"} Jul 08 15:57:10.703661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.703649 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"5dcadc1919a0da68528ac4265bb09be0c936356a809735f92df2b770a0a8e6e8"} Jul 08 15:57:10.704967 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.704940 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb8c4765d-lxk5q" event={"ID":"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e","Type":"ContainerStarted","Data":"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604"} Jul 08 15:57:10.705130 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.704978 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb8c4765d-lxk5q" event={"ID":"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e","Type":"ContainerStarted","Data":"03775b695613badcc411c5aefe256f5bc5489fd479ac474c45efdd5d2e73f13b"} Jul 08 15:57:10.706056 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.706028 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" event={"ID":"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73","Type":"ContainerStarted","Data":"dfa0db1575aef7082796fa4d3696735ee2edd82fa90ae621493eea537459ce0a"} Jul 08 15:57:10.732722 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:10.732608 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fb8c4765d-lxk5q" podStartSLOduration=0.732591308 podStartE2EDuration="732.591308ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:10.732320528 +0000 UTC m=+83.010416409" watchObservedRunningTime="2026-07-08 15:57:10.732591308 +0000 UTC m=+83.010687161" Jul 08 15:57:11.973448 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:11.973411 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:13.721574 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:13.721543 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" event={"ID":"e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73","Type":"ContainerStarted","Data":"e34ae3d20d11fd89bb94aeb2ca53a9984a97cac897ee01d21fe5effcb839f355"} Jul 08 15:57:13.724606 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:13.724581 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"860a9cf8-7b2d-4f13-b940-b037d560203d","Type":"ContainerStarted","Data":"41b58b596e815dbf6311d73149e6b6d3ee608d317d127b5038ea0c801f344ce5"} Jul 08 15:57:13.793922 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:13.793865 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" podStartSLOduration=2.444715087 podStartE2EDuration="4.793848313s" totalImagesPullingTime="2.349133226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:13.792677044 +0000 UTC m=+86.070772932" watchObservedRunningTime="2026-07-08 15:57:13.793848313 +0000 UTC m=+86.071944240" Jul 08 15:57:13.846042 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:13.845984 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.67174873 podStartE2EDuration="7.845967849s" totalImagesPullingTime="5.151051726s" totalInitContainerRuntime="23.167393ms" isStatefulPod=false podCreationTimestamp="2026-07-08 15:57:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:57:13.845296392 +0000 UTC m=+86.123392259" watchObservedRunningTime="2026-07-08 15:57:13.845967849 +0000 UTC m=+86.124063706" Jul 08 15:57:16.639354 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:16.639316 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:16.782703 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:16.782659 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:20.373985 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:20.373943 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:20.374393 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:20.374023 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:20.379627 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:20.379600 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:20.759031 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:20.758930 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:57:20.839938 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:20.839898 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:57:21.020781 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:21.020679 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:21.115048 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:21.115013 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:22.341299 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:22.341265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:22.489678 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:22.489644 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:23.908312 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:23.908279 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:24.022533 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:24.022503 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:24.130281 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:24.130254 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:29.756662 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:29.756614 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-76848766c8-89w47" podUID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" containerName="console" containerID="cri-o://b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6" gracePeriod=15 Jul 08 15:57:29.998660 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:29.998627 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:30.270900 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.270869 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:30.271172 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.270964 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:30.532270 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.532198 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:30.595340 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595307 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595350 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wfck9\" (UniqueName: \"kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595376 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595393 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595421 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595512 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595478 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config\") pod \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\" (UID: \"8ee5ceb7-2eb3-46c7-92ad-9927fa996494\") " Jul 08 15:57:30.595866 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595832 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca" (OuterVolumeSpecName: "service-ca") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:30.595866 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595847 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:30.596018 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.595867 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config" (OuterVolumeSpecName: "console-config") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:30.597805 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.597779 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9" (OuterVolumeSpecName: "kube-api-access-wfck9") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "kube-api-access-wfck9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:57:30.597805 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.597792 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:57:30.597955 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.597851 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8ee5ceb7-2eb3-46c7-92ad-9927fa996494" (UID: "8ee5ceb7-2eb3-46c7-92ad-9927fa996494"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:57:30.696043 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696010 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.696043 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696037 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-service-ca\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.696043 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696046 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wfck9\" (UniqueName: \"kubernetes.io/projected/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-kube-api-access-wfck9\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.696278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696057 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.696278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696068 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-console-oauth-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.696278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.696077 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8ee5ceb7-2eb3-46c7-92ad-9927fa996494-oauth-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:30.792354 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.792274 2558 generic.go:356] "Generic (PLEG): container finished" podID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" containerID="b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6" exitCode=0 Jul 08 15:57:30.792354 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.792319 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76848766c8-89w47" Jul 08 15:57:30.792799 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.792357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76848766c8-89w47" event={"ID":"8ee5ceb7-2eb3-46c7-92ad-9927fa996494","Type":"ContainerDied","Data":"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6"} Jul 08 15:57:30.792799 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.792407 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76848766c8-89w47" event={"ID":"8ee5ceb7-2eb3-46c7-92ad-9927fa996494","Type":"ContainerDied","Data":"dcab5ba47c16acd39694294efc4e748d63e9c700fb09ebf9f55a7255e7d96d01"} Jul 08 15:57:30.792799 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.792435 2558 scope.go:117] "RemoveContainer" containerID="b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6" Jul 08 15:57:30.801461 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.801445 2558 scope.go:117] "RemoveContainer" containerID="b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6" Jul 08 15:57:30.801744 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:57:30.801726 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6\": container with ID starting with b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6 not found: ID does not exist" containerID="b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6" Jul 08 15:57:30.801794 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.801754 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6"} err="failed to get container status \"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6\": rpc error: code = NotFound desc = could not find container \"b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6\": container with ID starting with b1245422d73f101273d9d97581b8b39785ad62a83a71c50246e9d73d015231c6 not found: ID does not exist" Jul 08 15:57:30.819631 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.819602 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:57:30.834495 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:30.834466 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76848766c8-89w47"] Jul 08 15:57:32.326995 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:32.326949 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" path="/var/lib/kubelet/pods/8ee5ceb7-2eb3-46c7-92ad-9927fa996494/volumes" Jul 08 15:57:32.656475 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:32.656444 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cx7b4" Jul 08 15:57:32.914767 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:32.914678 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pklc7_8b11d0df-d1a6-464b-8547-cf2be847cc3a/serve-healthcheck-canary/0.log" Jul 08 15:57:45.868566 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:45.868495 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7646c458f6-vqq22" podUID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" containerName="console" containerID="cri-o://607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d" gracePeriod=15 Jul 08 15:57:46.150789 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.150757 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226384 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226452 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226487 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226536 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226563 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226651 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlpjw\" (UniqueName: \"kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.226688 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle\") pod \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\" (UID: \"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5\") " Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.227411 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.227668 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca" (OuterVolumeSpecName: "service-ca") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:46.228188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.227901 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config" (OuterVolumeSpecName: "console-config") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:46.229214 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.228404 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:57:46.234410 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.234360 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw" (OuterVolumeSpecName: "kube-api-access-xlpjw") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "kube-api-access-xlpjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:57:46.234665 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.234631 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:57:46.236665 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.236639 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" (UID: "77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:57:46.328592 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328551 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlpjw\" (UniqueName: \"kubernetes.io/projected/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-kube-api-access-xlpjw\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328592 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328591 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-trusted-ca-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328609 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-oauth-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328623 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-service-ca\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328638 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328652 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.328869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.328666 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5-console-oauth-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:57:46.645252 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.645214 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:46.735360 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.735325 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:46.858395 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.858364 2558 generic.go:356] "Generic (PLEG): container finished" podID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" containerID="607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d" exitCode=0 Jul 08 15:57:46.858593 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.858410 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7646c458f6-vqq22" Jul 08 15:57:46.858593 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.858434 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7646c458f6-vqq22" event={"ID":"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5","Type":"ContainerDied","Data":"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d"} Jul 08 15:57:46.858593 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.858485 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7646c458f6-vqq22" event={"ID":"77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5","Type":"ContainerDied","Data":"0d3f9863dd9a30acb6271cefc5b09c7a1d76fb277cd08bd72507306f691969ef"} Jul 08 15:57:46.858593 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.858511 2558 scope.go:117] "RemoveContainer" containerID="607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d" Jul 08 15:57:46.866661 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.866639 2558 scope.go:117] "RemoveContainer" containerID="607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d" Jul 08 15:57:46.866938 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:57:46.866922 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d\": container with ID starting with 607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d not found: ID does not exist" containerID="607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d" Jul 08 15:57:46.866983 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.866946 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d"} err="failed to get container status \"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d\": rpc error: code = NotFound desc = could not find container \"607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d\": container with ID starting with 607a1839337804b51916d70568260ae75cd90a675cb2f76067383ef64fa33f7d not found: ID does not exist" Jul 08 15:57:46.877354 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.877327 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:57:46.881956 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:46.881917 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7646c458f6-vqq22"] Jul 08 15:57:48.326399 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:48.326367 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" path="/var/lib/kubelet/pods/77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5/volumes" Jul 08 15:57:50.276372 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:50.276348 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:50.280162 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:50.280140 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-75dfd6d966-xttqf" Jul 08 15:57:53.458196 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:53.458155 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:53.569113 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:53.569064 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:57:53.871691 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:57:53.871664 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:07.505153 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:07.505120 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:16.212186 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:16.212153 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:24.729708 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:24.729670 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:24.880562 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:24.880528 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:29.948036 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948000 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6dbbccdd68-v9875"] Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948288 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" containerName="console" Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948299 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" containerName="console" Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948311 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" containerName="console" Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948316 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" containerName="console" Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948387 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ee5ceb7-2eb3-46c7-92ad-9927fa996494" containerName="console" Jul 08 15:58:29.948457 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.948396 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="77a64ff5-ea7a-4ab8-bb8d-814bf883eaa5" containerName="console" Jul 08 15:58:29.952600 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.952580 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.959465 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.959442 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 08 15:58:29.959670 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.959657 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 08 15:58:29.959811 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.959795 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 08 15:58:29.959896 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.959838 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 08 15:58:29.960180 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.960165 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 08 15:58:29.960962 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.960946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2xdqm\"" Jul 08 15:58:29.969165 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.969140 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 08 15:58:29.972115 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.972061 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dbbccdd68-v9875"] Jul 08 15:58:29.996218 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996218 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996220 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-metrics-client-ca\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996396 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996396 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996257 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996396 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996281 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjcm6\" (UniqueName: \"kubernetes.io/projected/6f740551-ac8f-40be-9895-2124d08d55b0-kube-api-access-mjcm6\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996396 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-federate-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996540 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996401 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:29.996540 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:29.996419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-serving-certs-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097001 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.096949 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097001 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097007 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-serving-certs-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097070 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-metrics-client-ca\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097165 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097195 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjcm6\" (UniqueName: \"kubernetes.io/projected/6f740551-ac8f-40be-9895-2124d08d55b0-kube-api-access-mjcm6\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097303 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097235 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-federate-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097843 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097820 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-serving-certs-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.097970 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097929 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-metrics-client-ca\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.098040 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.097987 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.099674 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.099648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.099889 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.099867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-federate-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.100020 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.100006 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-secret-telemeter-client\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.100077 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.100059 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6f740551-ac8f-40be-9895-2124d08d55b0-telemeter-client-tls\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.109652 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.109619 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjcm6\" (UniqueName: \"kubernetes.io/projected/6f740551-ac8f-40be-9895-2124d08d55b0-kube-api-access-mjcm6\") pod \"telemeter-client-6dbbccdd68-v9875\" (UID: \"6f740551-ac8f-40be-9895-2124d08d55b0\") " pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.261448 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.261367 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" Jul 08 15:58:30.433727 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:30.433688 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dbbccdd68-v9875"] Jul 08 15:58:30.439035 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:58:30.439001 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f740551_ac8f_40be_9895_2124d08d55b0.slice/crio-454e499128e7575954ac58530dca7bf1ef46e57f9ffd8d548205f398b5e4c20a WatchSource:0}: Error finding container 454e499128e7575954ac58530dca7bf1ef46e57f9ffd8d548205f398b5e4c20a: Status 404 returned error can't find the container with id 454e499128e7575954ac58530dca7bf1ef46e57f9ffd8d548205f398b5e4c20a Jul 08 15:58:31.019189 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:31.019156 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" event={"ID":"6f740551-ac8f-40be-9895-2124d08d55b0","Type":"ContainerStarted","Data":"454e499128e7575954ac58530dca7bf1ef46e57f9ffd8d548205f398b5e4c20a"} Jul 08 15:58:32.024410 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:32.024377 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" event={"ID":"6f740551-ac8f-40be-9895-2124d08d55b0","Type":"ContainerStarted","Data":"e85bc7c35680d8c437ac2a6233c711f4da9a66c1eed717e0f78db901814a6557"} Jul 08 15:58:32.024736 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:32.024477 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" event={"ID":"6f740551-ac8f-40be-9895-2124d08d55b0","Type":"ContainerStarted","Data":"2e0def17150811338a052fb44658b26d0efc5e9a6153a05fd85395f4029889d9"} Jul 08 15:58:33.030010 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.029967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" event={"ID":"6f740551-ac8f-40be-9895-2124d08d55b0","Type":"ContainerStarted","Data":"f4c49ab8a0f76ef9c67db08b6715b66f31ace74d03ac4ace68f2956b7ddbe20e"} Jul 08 15:58:33.064024 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.063964 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6dbbccdd68-v9875" podStartSLOduration=2.637715693 podStartE2EDuration="4.063933468s" totalImagesPullingTime="1.426217775s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:33.062304655 +0000 UTC m=+165.340400532" watchObservedRunningTime="2026-07-08 15:58:33.063933468 +0000 UTC m=+165.342029371" Jul 08 15:58:33.788013 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.787979 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:58:33.791263 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.791244 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.807419 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.807388 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:58:33.831685 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831659 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831826 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831698 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45l72\" (UniqueName: \"kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831826 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831826 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831745 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831826 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831968 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831857 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.831968 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.831921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.873445 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.873414 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:33.932815 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.932777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.932999 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.932833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45l72\" (UniqueName: \"kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.932999 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.932864 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.932999 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.932894 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933192 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933027 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933192 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933192 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933853 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933825 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933990 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933826 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933990 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.933990 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.933938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.935798 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.935773 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.935903 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.935846 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.943096 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.943053 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45l72\" (UniqueName: \"kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72\") pod \"console-6b6957c56f-sldg2\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:33.974628 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:33.974595 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:34.099918 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:34.099834 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:34.113337 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:34.113308 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:34.254565 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:34.254537 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:58:34.258749 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:58:34.257779 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84db9747_2b55_41e1_b0c1_ebf6f962ddd0.slice/crio-cba6e3606ee49d334011004db989ab1f4388f2138a5b4a0244cf74e448a702e9 WatchSource:0}: Error finding container cba6e3606ee49d334011004db989ab1f4388f2138a5b4a0244cf74e448a702e9: Status 404 returned error can't find the container with id cba6e3606ee49d334011004db989ab1f4388f2138a5b4a0244cf74e448a702e9 Jul 08 15:58:34.623279 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:34.623244 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:34.723612 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:34.723577 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:35.039505 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:35.039418 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6957c56f-sldg2" event={"ID":"84db9747-2b55-41e1-b0c1-ebf6f962ddd0","Type":"ContainerStarted","Data":"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2"} Jul 08 15:58:35.039505 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:35.039464 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6957c56f-sldg2" event={"ID":"84db9747-2b55-41e1-b0c1-ebf6f962ddd0","Type":"ContainerStarted","Data":"cba6e3606ee49d334011004db989ab1f4388f2138a5b4a0244cf74e448a702e9"} Jul 08 15:58:35.060623 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:35.060571 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6957c56f-sldg2" podStartSLOduration=2.060552915 podStartE2EDuration="2.060552915s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:35.059492849 +0000 UTC m=+167.337588725" watchObservedRunningTime="2026-07-08 15:58:35.060552915 +0000 UTC m=+167.338648772" Jul 08 15:58:40.104754 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:40.104663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:40.198371 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:40.198320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:44.100763 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:44.100724 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:44.101243 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:44.100786 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:44.105604 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:44.105585 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:45.079835 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.079807 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:58:45.137809 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.137775 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:58:45.258859 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.258818 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 15:58:45.262357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.262333 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.274768 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.274742 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 15:58:45.276149 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.276126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:45.334505 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334419 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334505 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334461 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334505 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334709 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334709 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334709 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334558 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.334709 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.334573 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcdps\" (UniqueName: \"kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.435735 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.435699 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.435735 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.435740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.435939 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.435778 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.435939 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.435802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.435939 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.435922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcdps\" (UniqueName: \"kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436047 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436023 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436131 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436071 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436511 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436486 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436622 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436569 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436793 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.436931 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.436911 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.438378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.438354 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.438378 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.438377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.444960 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.444937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcdps\" (UniqueName: \"kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps\") pod \"console-8489fb5596-hgsd7\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.572019 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.571979 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:45.579388 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.579344 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:45.637545 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.637514 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:45.710028 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:45.709997 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 15:58:45.713240 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:58:45.713196 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7deee5a3_e270_4155_bbcc_f67ddf701762.slice/crio-8a898bcc3ae3b2014196c619f4a0e977bb101d1c17a4d6f2b30dab1d75cf560d WatchSource:0}: Error finding container 8a898bcc3ae3b2014196c619f4a0e977bb101d1c17a4d6f2b30dab1d75cf560d: Status 404 returned error can't find the container with id 8a898bcc3ae3b2014196c619f4a0e977bb101d1c17a4d6f2b30dab1d75cf560d Jul 08 15:58:46.081145 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.081114 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489fb5596-hgsd7" event={"ID":"7deee5a3-e270-4155-bbcc-f67ddf701762","Type":"ContainerStarted","Data":"e786a18d5e280248d548b6f9415225fa5d80557f9f970340858ad06ef886e4cc"} Jul 08 15:58:46.081357 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.081167 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489fb5596-hgsd7" event={"ID":"7deee5a3-e270-4155-bbcc-f67ddf701762","Type":"ContainerStarted","Data":"8a898bcc3ae3b2014196c619f4a0e977bb101d1c17a4d6f2b30dab1d75cf560d"} Jul 08 15:58:46.101048 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.100995 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8489fb5596-hgsd7" podStartSLOduration=1.100977796 podStartE2EDuration="1.100977796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:58:46.099983638 +0000 UTC m=+178.378079558" watchObservedRunningTime="2026-07-08 15:58:46.100977796 +0000 UTC m=+178.379073736" Jul 08 15:58:46.186188 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.186150 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:46.241952 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.241920 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:46.985539 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:46.985505 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:47.056270 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:47.056237 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:52.035259 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:52.035230 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:52.142822 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:52.142789 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:55.572147 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:55.572111 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:55.572532 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:55.572198 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:55.577219 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:55.577199 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:56.123157 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:56.123132 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 15:58:56.176571 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:56.176541 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:58:56.303362 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:56.303328 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:56.407229 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:56.407126 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:58:56.487064 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:58:56.487036 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:01.609373 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:01.609341 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:01.713641 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:01.713611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:02.911878 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:02.911833 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:02.975369 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:02.975333 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:10.164242 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.164175 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5fb8c4765d-lxk5q" podUID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" containerName="console" containerID="cri-o://8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604" gracePeriod=15 Jul 08 15:59:10.406375 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.406347 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:59:10.451496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451406 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4h9xg\" (UniqueName: \"kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451496 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451461 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451721 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451510 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451721 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451538 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451721 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451560 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451866 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451712 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.451866 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451765 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca\") pod \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\" (UID: \"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e\") " Jul 08 15:59:10.452002 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.451973 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config" (OuterVolumeSpecName: "console-config") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:10.452059 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.452001 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:10.452139 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.452047 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:10.452323 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.452294 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca" (OuterVolumeSpecName: "service-ca") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:10.453699 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.453680 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:10.454063 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.454041 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg" (OuterVolumeSpecName: "kube-api-access-4h9xg") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "kube-api-access-4h9xg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:10.454063 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.454042 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" (UID: "eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:10.552775 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552727 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-oauth-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.552775 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552771 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.552775 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552784 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-oauth-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.553030 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552799 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-service-ca\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.553030 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552813 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4h9xg\" (UniqueName: \"kubernetes.io/projected/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-kube-api-access-4h9xg\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.553030 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552825 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-trusted-ca-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:10.553030 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:10.552836 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e-console-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:11.177692 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.177660 2558 generic.go:356] "Generic (PLEG): container finished" podID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" containerID="8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604" exitCode=0 Jul 08 15:59:11.178156 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.177703 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fb8c4765d-lxk5q" Jul 08 15:59:11.178156 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.177713 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb8c4765d-lxk5q" event={"ID":"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e","Type":"ContainerDied","Data":"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604"} Jul 08 15:59:11.178156 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.177755 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fb8c4765d-lxk5q" event={"ID":"eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e","Type":"ContainerDied","Data":"03775b695613badcc411c5aefe256f5bc5489fd479ac474c45efdd5d2e73f13b"} Jul 08 15:59:11.178156 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.177774 2558 scope.go:117] "RemoveContainer" containerID="8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604" Jul 08 15:59:11.186355 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.186336 2558 scope.go:117] "RemoveContainer" containerID="8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604" Jul 08 15:59:11.186612 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:59:11.186594 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604\": container with ID starting with 8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604 not found: ID does not exist" containerID="8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604" Jul 08 15:59:11.186665 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.186621 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604"} err="failed to get container status \"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604\": rpc error: code = NotFound desc = could not find container \"8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604\": container with ID starting with 8ee315e20721db1827b33419aab8c6d440a6638e175b78eacbb4ae6792fb3604 not found: ID does not exist" Jul 08 15:59:11.201851 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.201827 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:59:11.205875 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:11.205844 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fb8c4765d-lxk5q"] Jul 08 15:59:12.326930 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:12.326897 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" path="/var/lib/kubelet/pods/eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e/volumes" Jul 08 15:59:14.856870 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:14.856843 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:21.198281 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.198220 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6b6957c56f-sldg2" podUID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" containerName="console" containerID="cri-o://65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2" gracePeriod=15 Jul 08 15:59:21.440390 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.440367 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:59:21.543004 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.542907 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45l72\" (UniqueName: \"kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543004 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.542959 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543008 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543039 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543065 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543121 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543278 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543151 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle\") pod \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\" (UID: \"84db9747-2b55-41e1-b0c1-ebf6f962ddd0\") " Jul 08 15:59:21.543517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543491 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca" (OuterVolumeSpecName: "service-ca") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:21.543606 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543504 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:21.543657 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543606 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config" (OuterVolumeSpecName: "console-config") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:21.543729 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.543699 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 15:59:21.545248 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.545226 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72" (OuterVolumeSpecName: "kube-api-access-45l72") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "kube-api-access-45l72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 15:59:21.545609 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.545592 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:21.545679 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.545609 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "84db9747-2b55-41e1-b0c1-ebf6f962ddd0" (UID: "84db9747-2b55-41e1-b0c1-ebf6f962ddd0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 15:59:21.644287 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644252 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-oauth-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644287 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644280 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644287 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644290 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-console-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644329 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-trusted-ca-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644339 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45l72\" (UniqueName: \"kubernetes.io/projected/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-kube-api-access-45l72\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644349 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-oauth-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:21.644517 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:21.644359 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84db9747-2b55-41e1-b0c1-ebf6f962ddd0-service-ca\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 15:59:22.220572 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.220530 2558 generic.go:356] "Generic (PLEG): container finished" podID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" containerID="65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2" exitCode=0 Jul 08 15:59:22.220993 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.220594 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6957c56f-sldg2" Jul 08 15:59:22.220993 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.220611 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6957c56f-sldg2" event={"ID":"84db9747-2b55-41e1-b0c1-ebf6f962ddd0","Type":"ContainerDied","Data":"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2"} Jul 08 15:59:22.220993 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.220684 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6957c56f-sldg2" event={"ID":"84db9747-2b55-41e1-b0c1-ebf6f962ddd0","Type":"ContainerDied","Data":"cba6e3606ee49d334011004db989ab1f4388f2138a5b4a0244cf74e448a702e9"} Jul 08 15:59:22.220993 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.220704 2558 scope.go:117] "RemoveContainer" containerID="65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2" Jul 08 15:59:22.229785 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.229770 2558 scope.go:117] "RemoveContainer" containerID="65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2" Jul 08 15:59:22.230066 ip-10-0-128-249 kubenswrapper[2558]: E0708 15:59:22.230034 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2\": container with ID starting with 65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2 not found: ID does not exist" containerID="65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2" Jul 08 15:59:22.230202 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.230074 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2"} err="failed to get container status \"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2\": rpc error: code = NotFound desc = could not find container \"65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2\": container with ID starting with 65292ca20a8c86181c50edef4b56d6c011e714b5a18fd4a793ce59df68d7e9b2 not found: ID does not exist" Jul 08 15:59:22.242160 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.242133 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:59:22.247762 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.247738 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6957c56f-sldg2"] Jul 08 15:59:22.327023 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:22.326993 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" path="/var/lib/kubelet/pods/84db9747-2b55-41e1-b0c1-ebf6f962ddd0/volumes" Jul 08 15:59:39.857037 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:39.857000 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:39.961858 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:39.961828 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 15:59:40.887759 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.887717 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt"] Jul 08 15:59:40.888448 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888428 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" containerName="console" Jul 08 15:59:40.888532 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888451 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" containerName="console" Jul 08 15:59:40.888532 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888463 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" containerName="console" Jul 08 15:59:40.888532 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888473 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" containerName="console" Jul 08 15:59:40.888664 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888605 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="eafd55fe-bfdc-4fc5-8556-8c7e4d29f09e" containerName="console" Jul 08 15:59:40.888664 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.888615 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="84db9747-2b55-41e1-b0c1-ebf6f962ddd0" containerName="console" Jul 08 15:59:40.892537 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.892512 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:40.895735 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.895714 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 15:59:40.895853 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.895714 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 15:59:40.897233 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.897206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pfp5m\"" Jul 08 15:59:40.899309 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.899288 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt"] Jul 08 15:59:40.993393 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.993359 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:40.993588 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.993397 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6bbz\" (UniqueName: \"kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:40.993588 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:40.993435 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.094430 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.094398 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.094430 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.094432 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6bbz\" (UniqueName: \"kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.094637 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.094467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.094782 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.094766 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.094841 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.094818 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.106774 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.106741 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6bbz\" (UniqueName: \"kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.202695 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.202615 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 15:59:41.340101 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:41.339924 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt"] Jul 08 15:59:41.342706 ip-10-0-128-249 kubenswrapper[2558]: W0708 15:59:41.342678 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a9d417c_9b33_45db_9815_28e2fc14a4c1.slice/crio-95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c WatchSource:0}: Error finding container 95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c: Status 404 returned error can't find the container with id 95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c Jul 08 15:59:42.298104 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:42.298051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerStarted","Data":"95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c"} Jul 08 15:59:49.327905 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:49.327862 2558 generic.go:356] "Generic (PLEG): container finished" podID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerID="6e9715860b47f558d48f3a0a765bff7dd2668315bf731c787c5ed1c7a25f44dc" exitCode=0 Jul 08 15:59:49.328338 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:49.327946 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerDied","Data":"6e9715860b47f558d48f3a0a765bff7dd2668315bf731c787c5ed1c7a25f44dc"} Jul 08 15:59:52.347869 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:52.347834 2558 generic.go:356] "Generic (PLEG): container finished" podID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerID="8403c36c0acf028c5a9dd45fca82a52f3c549f4f1e28091695c3e84dfe32acdc" exitCode=0 Jul 08 15:59:52.348284 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:52.347893 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerDied","Data":"8403c36c0acf028c5a9dd45fca82a52f3c549f4f1e28091695c3e84dfe32acdc"} Jul 08 15:59:58.376329 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:58.376292 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerStarted","Data":"12bed578f531f0ef882a949fe31a2a7c048eb50da41443716121e1352cafc182"} Jul 08 15:59:58.397370 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:58.397317 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" podStartSLOduration=3.222231561 podStartE2EDuration="18.397300772s" totalImagesPullingTime="15.175069211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 15:59:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 15:59:58.395413649 +0000 UTC m=+250.673509539" watchObservedRunningTime="2026-07-08 15:59:58.397300772 +0000 UTC m=+250.675396628" Jul 08 15:59:59.381268 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:59.381232 2558 generic.go:356] "Generic (PLEG): container finished" podID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerID="12bed578f531f0ef882a949fe31a2a7c048eb50da41443716121e1352cafc182" exitCode=0 Jul 08 15:59:59.381651 ip-10-0-128-249 kubenswrapper[2558]: I0708 15:59:59.381272 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerDied","Data":"12bed578f531f0ef882a949fe31a2a7c048eb50da41443716121e1352cafc182"} Jul 08 16:00:00.514015 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.513992 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 16:00:00.668560 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.668466 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle\") pod \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " Jul 08 16:00:00.668560 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.668526 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6bbz\" (UniqueName: \"kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz\") pod \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " Jul 08 16:00:00.668560 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.668558 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util\") pod \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\" (UID: \"9a9d417c-9b33-45db-9815-28e2fc14a4c1\") " Jul 08 16:00:00.669250 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.669223 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle" (OuterVolumeSpecName: "bundle") pod "9a9d417c-9b33-45db-9815-28e2fc14a4c1" (UID: "9a9d417c-9b33-45db-9815-28e2fc14a4c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:00.670717 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.670689 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz" (OuterVolumeSpecName: "kube-api-access-g6bbz") pod "9a9d417c-9b33-45db-9815-28e2fc14a4c1" (UID: "9a9d417c-9b33-45db-9815-28e2fc14a4c1"). InnerVolumeSpecName "kube-api-access-g6bbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:00:00.673510 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.673484 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util" (OuterVolumeSpecName: "util") pod "9a9d417c-9b33-45db-9815-28e2fc14a4c1" (UID: "9a9d417c-9b33-45db-9815-28e2fc14a4c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:00.769653 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.769612 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:00.769653 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.769646 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a9d417c-9b33-45db-9815-28e2fc14a4c1-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:00.769653 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:00.769654 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6bbz\" (UniqueName: \"kubernetes.io/projected/9a9d417c-9b33-45db-9815-28e2fc14a4c1-kube-api-access-g6bbz\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:01.390435 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:01.390408 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" Jul 08 16:00:01.390435 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:01.390414 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540dv4nt" event={"ID":"9a9d417c-9b33-45db-9815-28e2fc14a4c1","Type":"ContainerDied","Data":"95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c"} Jul 08 16:00:01.390639 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:01.390455 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95999203d693b49c398968185e888584ab2b5ac83f9119b7cb307759ee45526c" Jul 08 16:00:07.066136 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:07.066103 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:08.105030 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:08.104995 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:08.207160 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:08.207127 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:09.246890 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.246811 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55"] Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247135 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="util" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247150 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="util" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247161 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="extract" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247167 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="extract" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247186 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="pull" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247192 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="pull" Jul 08 16:00:09.247374 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.247240 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a9d417c-9b33-45db-9815-28e2fc14a4c1" containerName="extract" Jul 08 16:00:09.257027 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.257004 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.260265 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.260239 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 16:00:09.260265 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.260242 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-nptkk\"" Jul 08 16:00:09.260455 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.260437 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 16:00:09.266808 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.266786 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55"] Jul 08 16:00:09.338074 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.338038 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.338272 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.338248 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ht69\" (UniqueName: \"kubernetes.io/projected/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-kube-api-access-2ht69\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.438783 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.438740 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ht69\" (UniqueName: \"kubernetes.io/projected/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-kube-api-access-2ht69\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.438964 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.438810 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.439191 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.439172 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.452758 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.452720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ht69\" (UniqueName: \"kubernetes.io/projected/fe906c67-b86b-42fb-9f43-ff37dd0ab3ff-kube-api-access-2ht69\") pod \"cert-manager-operator-controller-manager-55c444bf86-jdj55\" (UID: \"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.566698 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.566618 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" Jul 08 16:00:09.738022 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:09.737987 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55"] Jul 08 16:00:09.742422 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:09.742388 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe906c67_b86b_42fb_9f43_ff37dd0ab3ff.slice/crio-531e4f386a4088e38a6cf261aea329a639fe36279afe23920c63cb2383ca6064 WatchSource:0}: Error finding container 531e4f386a4088e38a6cf261aea329a639fe36279afe23920c63cb2383ca6064: Status 404 returned error can't find the container with id 531e4f386a4088e38a6cf261aea329a639fe36279afe23920c63cb2383ca6064 Jul 08 16:00:10.426281 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:10.426251 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" event={"ID":"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff","Type":"ContainerStarted","Data":"531e4f386a4088e38a6cf261aea329a639fe36279afe23920c63cb2383ca6064"} Jul 08 16:00:11.230481 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:11.230447 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:11.339416 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:11.339370 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:13.440811 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:13.440778 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" event={"ID":"fe906c67-b86b-42fb-9f43-ff37dd0ab3ff","Type":"ContainerStarted","Data":"410f1b385a860a9d78509d220cfadcbfa456c5cb278e6df8ae14349385ab9893"} Jul 08 16:00:13.467661 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:13.467600 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jdj55" podStartSLOduration=1.261628639 podStartE2EDuration="4.467581672s" totalImagesPullingTime="3.205953033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:13.465782369 +0000 UTC m=+265.743878251" watchObservedRunningTime="2026-07-08 16:00:13.467581672 +0000 UTC m=+265.745677528" Jul 08 16:00:13.711586 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:13.711485 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:14.223310 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.223282 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh"] Jul 08 16:00:14.225563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.225549 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.231287 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.231257 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:00:14.231416 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.231289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:00:14.232844 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.232830 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pfp5m\"" Jul 08 16:00:14.242778 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.242751 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh"] Jul 08 16:00:14.282753 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.282719 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.282934 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.282789 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhf67\" (UniqueName: \"kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.282934 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.282855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.383888 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.383852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhf67\" (UniqueName: \"kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.384042 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.383901 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.384042 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.383929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.384293 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.384277 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.384332 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.384308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.401142 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.401107 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhf67\" (UniqueName: \"kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.534288 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.534209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:14.671057 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:14.670959 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh"] Jul 08 16:00:14.673233 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:14.673203 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbec21c81_07b4_4737_baf5_f8f571ba4085.slice/crio-1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696 WatchSource:0}: Error finding container 1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696: Status 404 returned error can't find the container with id 1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696 Jul 08 16:00:15.449931 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:15.449890 2558 generic.go:356] "Generic (PLEG): container finished" podID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerID="d32f8c09cf479078939ee6d3c96a2a60eae32bdbab5516cf4474ed1a69ebfdd5" exitCode=0 Jul 08 16:00:15.450130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:15.449980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" event={"ID":"bec21c81-07b4-4737-baf5-f8f571ba4085","Type":"ContainerDied","Data":"d32f8c09cf479078939ee6d3c96a2a60eae32bdbab5516cf4474ed1a69ebfdd5"} Jul 08 16:00:15.450130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:15.450023 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" event={"ID":"bec21c81-07b4-4737-baf5-f8f571ba4085","Type":"ContainerStarted","Data":"1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696"} Jul 08 16:00:15.893459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:15.893428 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:16.292601 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.292508 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:16.715821 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.715789 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv"] Jul 08 16:00:16.718279 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.718262 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.721276 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.721257 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 16:00:16.721393 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.721377 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 16:00:16.722877 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.722861 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-c54hf\"" Jul 08 16:00:16.734713 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.734684 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv"] Jul 08 16:00:16.803330 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.803294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.803507 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.803344 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trgt8\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-kube-api-access-trgt8\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.904726 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.904684 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.905146 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.904743 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trgt8\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-kube-api-access-trgt8\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.914593 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.914567 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:16.915229 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:16.915210 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trgt8\" (UniqueName: \"kubernetes.io/projected/3da3729c-157d-4bf6-a51e-47823da7d356-kube-api-access-trgt8\") pod \"cert-manager-cainjector-559cdd8c87-d6nqv\" (UID: \"3da3729c-157d-4bf6-a51e-47823da7d356\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:17.041716 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:17.041629 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" Jul 08 16:00:17.198337 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:17.198314 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv"] Jul 08 16:00:17.199485 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:17.199448 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3da3729c_157d_4bf6_a51e_47823da7d356.slice/crio-54b611019f63281929894f67d61200217ac1abeb98390c630e1af30a8c8217cc WatchSource:0}: Error finding container 54b611019f63281929894f67d61200217ac1abeb98390c630e1af30a8c8217cc: Status 404 returned error can't find the container with id 54b611019f63281929894f67d61200217ac1abeb98390c630e1af30a8c8217cc Jul 08 16:00:17.459315 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:17.459279 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" event={"ID":"3da3729c-157d-4bf6-a51e-47823da7d356","Type":"ContainerStarted","Data":"54b611019f63281929894f67d61200217ac1abeb98390c630e1af30a8c8217cc"} Jul 08 16:00:17.606695 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:17.606657 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:17.710183 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:17.710095 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:19.475901 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:19.475871 2558 generic.go:356] "Generic (PLEG): container finished" podID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerID="0cdd1e73ea3d87ba0659e4e848fd3907bad8f7b58af88c8d26ff1d24f8ff3be2" exitCode=0 Jul 08 16:00:19.476298 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:19.475926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" event={"ID":"bec21c81-07b4-4737-baf5-f8f571ba4085","Type":"ContainerDied","Data":"0cdd1e73ea3d87ba0659e4e848fd3907bad8f7b58af88c8d26ff1d24f8ff3be2"} Jul 08 16:00:20.482872 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:20.482840 2558 generic.go:356] "Generic (PLEG): container finished" podID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerID="a55df8d42aba1b50be353dc68b0c6e8c7c0597d4e316a0759bf3766c50fbb173" exitCode=0 Jul 08 16:00:20.483290 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:20.482914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" event={"ID":"bec21c81-07b4-4737-baf5-f8f571ba4085","Type":"ContainerDied","Data":"a55df8d42aba1b50be353dc68b0c6e8c7c0597d4e316a0759bf3766c50fbb173"} Jul 08 16:00:21.613675 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.613652 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:21.653669 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.653640 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhf67\" (UniqueName: \"kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67\") pod \"bec21c81-07b4-4737-baf5-f8f571ba4085\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " Jul 08 16:00:21.653829 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.653704 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util\") pod \"bec21c81-07b4-4737-baf5-f8f571ba4085\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " Jul 08 16:00:21.653829 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.653763 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle\") pod \"bec21c81-07b4-4737-baf5-f8f571ba4085\" (UID: \"bec21c81-07b4-4737-baf5-f8f571ba4085\") " Jul 08 16:00:21.654215 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.654186 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle" (OuterVolumeSpecName: "bundle") pod "bec21c81-07b4-4737-baf5-f8f571ba4085" (UID: "bec21c81-07b4-4737-baf5-f8f571ba4085"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:21.655815 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.655789 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67" (OuterVolumeSpecName: "kube-api-access-jhf67") pod "bec21c81-07b4-4737-baf5-f8f571ba4085" (UID: "bec21c81-07b4-4737-baf5-f8f571ba4085"). InnerVolumeSpecName "kube-api-access-jhf67". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:00:21.658210 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.658188 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util" (OuterVolumeSpecName: "util") pod "bec21c81-07b4-4737-baf5-f8f571ba4085" (UID: "bec21c81-07b4-4737-baf5-f8f571ba4085"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:21.754822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.754716 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:21.754822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.754751 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhf67\" (UniqueName: \"kubernetes.io/projected/bec21c81-07b4-4737-baf5-f8f571ba4085-kube-api-access-jhf67\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:21.754822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:21.754765 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bec21c81-07b4-4737-baf5-f8f571ba4085-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:22.492459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:22.492422 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" event={"ID":"bec21c81-07b4-4737-baf5-f8f571ba4085","Type":"ContainerDied","Data":"1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696"} Jul 08 16:00:22.492459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:22.492442 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fklmrh" Jul 08 16:00:22.492459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:22.492467 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1240656d041170d1d61f0336960185f699be52f403c554bfcc87a22524df3696" Jul 08 16:00:23.678429 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:23.678391 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:24.705885 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:24.705840 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:24.805509 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:24.805478 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:25.509138 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:25.509107 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" event={"ID":"3da3729c-157d-4bf6-a51e-47823da7d356","Type":"ContainerStarted","Data":"4891740a455d71643f757565b4b5f2c4e52bd0e52464e14cd3362ae1eb3d2f23"} Jul 08 16:00:25.528227 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:25.528162 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-d6nqv" podStartSLOduration=2.132348408 podStartE2EDuration="9.528145394s" totalImagesPullingTime="7.395796986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:25.526699011 +0000 UTC m=+277.804794878" watchObservedRunningTime="2026-07-08 16:00:25.528145394 +0000 UTC m=+277.806241251" Jul 08 16:00:26.021453 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021421 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fxm6x"] Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021724 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="util" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021735 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="util" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021746 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="pull" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021752 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="pull" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021767 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="extract" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021773 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="extract" Jul 08 16:00:26.021830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.021829 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bec21c81-07b4-4737-baf5-f8f571ba4085" containerName="extract" Jul 08 16:00:26.023733 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.023719 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.026867 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.026844 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-b7lq2\"" Jul 08 16:00:26.040457 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.040430 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fxm6x"] Jul 08 16:00:26.091586 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.091553 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qdxl"] Jul 08 16:00:26.093638 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.093623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.096068 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.096043 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxvzb\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-kube-api-access-zxvzb\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.096219 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.096158 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.097103 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.097067 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-6mqv6\"" Jul 08 16:00:26.120876 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.120844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qdxl"] Jul 08 16:00:26.196784 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.196752 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h78sq\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-kube-api-access-h78sq\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.196957 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.196811 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.196957 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.196914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxvzb\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-kube-api-access-zxvzb\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.197060 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.196984 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.209721 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.209683 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-bound-sa-token\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.209861 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.209695 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxvzb\" (UniqueName: \"kubernetes.io/projected/84193552-e13a-4f7a-9fbb-1af3627824ee-kube-api-access-zxvzb\") pod \"cert-manager-55b4d954d5-fxm6x\" (UID: \"84193552-e13a-4f7a-9fbb-1af3627824ee\") " pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.298466 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.298376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h78sq\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-kube-api-access-h78sq\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.298466 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.298424 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.308486 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.308452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.308642 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.308507 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h78sq\" (UniqueName: \"kubernetes.io/projected/d00de777-cb84-4471-8b96-23e48c5d1987-kube-api-access-h78sq\") pod \"cert-manager-webhook-6486ffd997-2qdxl\" (UID: \"d00de777-cb84-4471-8b96-23e48c5d1987\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.332959 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.332933 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fxm6x" Jul 08 16:00:26.402616 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.402586 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:26.471751 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.471526 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fxm6x"] Jul 08 16:00:26.474358 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:26.474313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84193552_e13a_4f7a_9fbb_1af3627824ee.slice/crio-d355d0ea1ffc1990e77d15e06eecea75c66a320d91459546a42b35610f058507 WatchSource:0}: Error finding container d355d0ea1ffc1990e77d15e06eecea75c66a320d91459546a42b35610f058507: Status 404 returned error can't find the container with id d355d0ea1ffc1990e77d15e06eecea75c66a320d91459546a42b35610f058507 Jul 08 16:00:26.519582 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.519037 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fxm6x" event={"ID":"84193552-e13a-4f7a-9fbb-1af3627824ee","Type":"ContainerStarted","Data":"d355d0ea1ffc1990e77d15e06eecea75c66a320d91459546a42b35610f058507"} Jul 08 16:00:26.560509 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.560422 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qdxl"] Jul 08 16:00:26.566060 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:26.566030 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd00de777_cb84_4471_8b96_23e48c5d1987.slice/crio-83201bcf3644b483e9ee69baf914cae4ed078b07a817bf0dd3d3b1e3d6a9ba93 WatchSource:0}: Error finding container 83201bcf3644b483e9ee69baf914cae4ed078b07a817bf0dd3d3b1e3d6a9ba93: Status 404 returned error can't find the container with id 83201bcf3644b483e9ee69baf914cae4ed078b07a817bf0dd3d3b1e3d6a9ba93 Jul 08 16:00:26.853766 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.853663 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:26.954258 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:26.954229 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:27.524557 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.524528 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fxm6x" event={"ID":"84193552-e13a-4f7a-9fbb-1af3627824ee","Type":"ContainerStarted","Data":"44abca31f5f94d8e0446526f1d1033e98e915fd442d93b652575ce57be4ff151"} Jul 08 16:00:27.526008 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.525983 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" event={"ID":"d00de777-cb84-4471-8b96-23e48c5d1987","Type":"ContainerStarted","Data":"67bc75b83db15c664d76b581aefc16a7e2bd2dcad4f0bf8e566645f446c70d64"} Jul 08 16:00:27.526139 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.526015 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" event={"ID":"d00de777-cb84-4471-8b96-23e48c5d1987","Type":"ContainerStarted","Data":"83201bcf3644b483e9ee69baf914cae4ed078b07a817bf0dd3d3b1e3d6a9ba93"} Jul 08 16:00:27.526139 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.526104 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:27.545239 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.545186 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fxm6x" podStartSLOduration=2.545169089 podStartE2EDuration="2.545169089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:27.544052323 +0000 UTC m=+279.822148180" watchObservedRunningTime="2026-07-08 16:00:27.545169089 +0000 UTC m=+279.823264947" Jul 08 16:00:27.565722 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:27.565675 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" podStartSLOduration=1.56565921 podStartE2EDuration="1.56565921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:27.564265415 +0000 UTC m=+279.842361275" watchObservedRunningTime="2026-07-08 16:00:27.56565921 +0000 UTC m=+279.843755066" Jul 08 16:00:31.077476 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:31.077440 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:31.174241 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:31.174208 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:32.716699 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.716664 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd"] Jul 08 16:00:32.719394 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.719377 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.722272 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.722245 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 16:00:32.722397 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.722334 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 16:00:32.722440 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.722408 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-pfp5m\"" Jul 08 16:00:32.728942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.728917 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd"] Jul 08 16:00:32.859174 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.859137 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.859174 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.859173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.859385 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.859199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvfmg\" (UniqueName: \"kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.959852 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.959807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.959852 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.959858 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.960026 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.959972 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvfmg\" (UniqueName: \"kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.960211 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.960195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.960281 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.960264 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:32.971001 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:32.970947 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvfmg\" (UniqueName: \"kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:33.029981 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.029935 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:33.101048 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.101019 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:33.164274 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.164252 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd"] Jul 08 16:00:33.166145 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:33.166124 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cb1b72_7796_4b8e_a4cb_71aa5e1bcfc3.slice/crio-86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826 WatchSource:0}: Error finding container 86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826: Status 404 returned error can't find the container with id 86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826 Jul 08 16:00:33.230443 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.230419 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:33.533382 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.533303 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2qdxl" Jul 08 16:00:33.562010 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.561977 2558 generic.go:356] "Generic (PLEG): container finished" podID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerID="9a6c0f319403b3f0df35df498f69b68d291f1ff5d34a2be7306e4b8e607adabd" exitCode=0 Jul 08 16:00:33.562193 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.562055 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" event={"ID":"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3","Type":"ContainerDied","Data":"9a6c0f319403b3f0df35df498f69b68d291f1ff5d34a2be7306e4b8e607adabd"} Jul 08 16:00:33.562193 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:33.562155 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" event={"ID":"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3","Type":"ContainerStarted","Data":"86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826"} Jul 08 16:00:34.568443 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:34.568410 2558 generic.go:356] "Generic (PLEG): container finished" podID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerID="7c111f92d78fd7dc81f0215f3b574efacacb1540446f637e6a005c1b491c2405" exitCode=0 Jul 08 16:00:34.568876 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:34.568466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" event={"ID":"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3","Type":"ContainerDied","Data":"7c111f92d78fd7dc81f0215f3b574efacacb1540446f637e6a005c1b491c2405"} Jul 08 16:00:35.575225 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:35.575179 2558 generic.go:356] "Generic (PLEG): container finished" podID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerID="c616e4c279f597453d503e20777374df07359545e155b927ba76400266bd1df2" exitCode=0 Jul 08 16:00:35.575613 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:35.575266 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" event={"ID":"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3","Type":"ContainerDied","Data":"c616e4c279f597453d503e20777374df07359545e155b927ba76400266bd1df2"} Jul 08 16:00:36.707845 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.707821 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:36.798399 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.798368 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle\") pod \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " Jul 08 16:00:36.798628 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.798435 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util\") pod \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " Jul 08 16:00:36.798628 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.798483 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvfmg\" (UniqueName: \"kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg\") pod \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\" (UID: \"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3\") " Jul 08 16:00:36.799178 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.799151 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle" (OuterVolumeSpecName: "bundle") pod "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" (UID: "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:36.800740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.800716 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg" (OuterVolumeSpecName: "kube-api-access-qvfmg") pod "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" (UID: "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3"). InnerVolumeSpecName "kube-api-access-qvfmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:00:36.804592 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.804567 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util" (OuterVolumeSpecName: "util") pod "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" (UID: "e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:00:36.899460 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.899418 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:36.899460 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.899459 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:36.899460 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:36.899469 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvfmg\" (UniqueName: \"kubernetes.io/projected/e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3-kube-api-access-qvfmg\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:00:37.585585 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:37.585559 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" Jul 08 16:00:37.585761 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:37.585557 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afvhzsd" event={"ID":"e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3","Type":"ContainerDied","Data":"86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826"} Jul 08 16:00:37.585761 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:37.585684 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="86a97f5b1b595c713448094ac405f8f3970c0e67d708d8d0a307ee3fb7b2b826" Jul 08 16:00:45.843199 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:45.843167 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:45.947130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:45.947100 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:46.463881 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.463849 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:46.809933 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.809854 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:46.919653 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.919613 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:46.950783 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.950752 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55"] Jul 08 16:00:46.951098 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951073 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="extract" Jul 08 16:00:46.951156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951100 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="extract" Jul 08 16:00:46.951156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951117 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="util" Jul 08 16:00:46.951156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951123 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="util" Jul 08 16:00:46.951156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951129 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="pull" Jul 08 16:00:46.951156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951135 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="pull" Jul 08 16:00:46.951327 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.951204 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2cb1b72-7796-4b8e-a4cb-71aa5e1bcfc3" containerName="extract" Jul 08 16:00:46.953309 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.953294 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:46.956831 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.956810 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 16:00:46.956959 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.956841 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pfz5v\"" Jul 08 16:00:46.957295 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.957274 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 16:00:46.957295 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.957289 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 16:00:46.963115 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.958029 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 16:00:46.978679 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.978647 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55"] Jul 08 16:00:46.983997 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.983972 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:46.984123 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.984020 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-manifests\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:46.984123 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.984105 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2l94z\" (UniqueName: \"kubernetes.io/projected/ee5610cf-05bd-461f-a667-71702971b95f-kube-api-access-2l94z\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:46.984201 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.984162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-webhook-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:46.984234 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:46.984202 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-tmp\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085394 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085298 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-manifests\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085394 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085345 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2l94z\" (UniqueName: \"kubernetes.io/projected/ee5610cf-05bd-461f-a667-71702971b95f-kube-api-access-2l94z\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085394 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085383 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-webhook-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085682 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085408 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-tmp\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085682 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085466 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.085795 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.085765 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-manifests\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.087699 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.087672 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ee5610cf-05bd-461f-a667-71702971b95f-tmp\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.087856 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.087798 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.087975 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.087955 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ee5610cf-05bd-461f-a667-71702971b95f-webhook-cert\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.149873 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.149840 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2l94z\" (UniqueName: \"kubernetes.io/projected/ee5610cf-05bd-461f-a667-71702971b95f-kube-api-access-2l94z\") pod \"opendatahub-operator-controller-manager-588bc5dd4b-nzv55\" (UID: \"ee5610cf-05bd-461f-a667-71702971b95f\") " pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.265906 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.265874 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:47.303125 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.303076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:47.413644 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.413612 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55"] Jul 08 16:00:47.414386 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.414350 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:47.415630 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:00:47.415609 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee5610cf_05bd_461f_a667_71702971b95f.slice/crio-dcd837ae93a0ac3782abffc773319193f103f5839f7cf60805cf1add52ed2d28 WatchSource:0}: Error finding container dcd837ae93a0ac3782abffc773319193f103f5839f7cf60805cf1add52ed2d28: Status 404 returned error can't find the container with id dcd837ae93a0ac3782abffc773319193f103f5839f7cf60805cf1add52ed2d28 Jul 08 16:00:47.516122 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.516055 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:47.615108 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.614991 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:47.631661 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.631631 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" event={"ID":"ee5610cf-05bd-461f-a667-71702971b95f","Type":"ContainerStarted","Data":"dcd837ae93a0ac3782abffc773319193f103f5839f7cf60805cf1add52ed2d28"} Jul 08 16:00:47.715131 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.715073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:47.812484 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:47.812450 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:48.196313 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:48.196285 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 16:00:48.201146 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:48.201119 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 16:00:48.204341 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:48.204309 2558 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 16:00:49.492580 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:49.492532 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:49.614549 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:49.614518 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:00:51.662868 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:51.662830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" event={"ID":"ee5610cf-05bd-461f-a667-71702971b95f","Type":"ContainerStarted","Data":"15d26c613b71daa768ab53d4216432ec73e6a58d7e681878a4c2a8838fc04e9b"} Jul 08 16:00:52.668500 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:52.668466 2558 generic.go:356] "Generic (PLEG): container finished" podID="ee5610cf-05bd-461f-a667-71702971b95f" containerID="15d26c613b71daa768ab53d4216432ec73e6a58d7e681878a4c2a8838fc04e9b" exitCode=0 Jul 08 16:00:52.668977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:52.668533 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" event={"ID":"ee5610cf-05bd-461f-a667-71702971b95f","Type":"ContainerDied","Data":"15d26c613b71daa768ab53d4216432ec73e6a58d7e681878a4c2a8838fc04e9b"} Jul 08 16:00:52.669169 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:52.669151 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:00:53.674885 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:53.674848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" event={"ID":"ee5610cf-05bd-461f-a667-71702971b95f","Type":"ContainerStarted","Data":"f9b093557e5dd512ea31965907df2499052e7a0db2c8dbf03735d769987b2ae6"} Jul 08 16:00:53.675503 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:53.674965 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:00:53.700424 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:00:53.700363 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" podStartSLOduration=2.687280428 podStartE2EDuration="7.700342451s" totalImagesPullingTime="3.987246079s" totalInitContainerRuntime="1.025815944s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:00:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:00:53.698302864 +0000 UTC m=+305.976398752" watchObservedRunningTime="2026-07-08 16:00:53.700342451 +0000 UTC m=+305.978438309" Jul 08 16:01:04.682198 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:04.682169 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-588bc5dd4b-nzv55" Jul 08 16:01:06.946141 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:06.946107 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:07.142246 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.142218 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:07.694128 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.694076 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:07.883947 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.883911 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf"] Jul 08 16:01:07.890640 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.890608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:07.901200 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.901178 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-kfsv8\"" Jul 08 16:01:07.902529 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.902511 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 16:01:07.902639 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.902533 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 08 16:01:07.902639 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.902544 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 08 16:01:07.902639 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.902558 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 16:01:07.929637 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.929607 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf"] Jul 08 16:01:07.977113 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.977016 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tmp\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:07.977113 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.977064 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:07.977507 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:07.977187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgm8k\" (UniqueName: \"kubernetes.io/projected/13afbb97-4b5d-4235-8b7d-6e2eb9907052-kube-api-access-xgm8k\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.077864 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.077828 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tmp\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.078014 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.077881 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.078014 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.077918 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgm8k\" (UniqueName: \"kubernetes.io/projected/13afbb97-4b5d-4235-8b7d-6e2eb9907052-kube-api-access-xgm8k\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.078113 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:08.078064 2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 08 16:01:08.078163 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:08.078142 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs podName:13afbb97-4b5d-4235-8b7d-6e2eb9907052 nodeName:}" failed. No retries permitted until 2026-07-08 16:01:08.57812416 +0000 UTC m=+320.856219995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs") pod "kube-auth-proxy-5d4b79bd44-srrnf" (UID: "13afbb97-4b5d-4235-8b7d-6e2eb9907052") : secret "kube-auth-proxy-tls" not found Jul 08 16:01:08.080044 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.080014 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tmp\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.090513 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.090489 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgm8k\" (UniqueName: \"kubernetes.io/projected/13afbb97-4b5d-4235-8b7d-6e2eb9907052-kube-api-access-xgm8k\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.123417 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.123378 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bbj9x"] Jul 08 16:01:08.126499 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.126478 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.129944 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.129923 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 08 16:01:08.130432 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.130419 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lfdtj\"" Jul 08 16:01:08.143181 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.143153 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bbj9x"] Jul 08 16:01:08.178143 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.178059 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:08.248228 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.248143 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:08.279455 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.279412 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.279592 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.279477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4s48\" (UniqueName: \"kubernetes.io/projected/c90e0a30-67af-4274-b56c-5f34d4bfab5d-kube-api-access-b4s48\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.380515 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.380478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.380697 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.380527 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4s48\" (UniqueName: \"kubernetes.io/projected/c90e0a30-67af-4274-b56c-5f34d4bfab5d-kube-api-access-b4s48\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.380697 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:08.380653 2558 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 08 16:01:08.380775 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:08.380745 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert podName:c90e0a30-67af-4274-b56c-5f34d4bfab5d nodeName:}" failed. No retries permitted until 2026-07-08 16:01:08.880723355 +0000 UTC m=+321.158819209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert") pod "odh-model-controller-7998c67dc4-bbj9x" (UID: "c90e0a30-67af-4274-b56c-5f34d4bfab5d") : secret "odh-model-controller-webhook-cert" not found Jul 08 16:01:08.391059 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.391031 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4s48\" (UniqueName: \"kubernetes.io/projected/c90e0a30-67af-4274-b56c-5f34d4bfab5d-kube-api-access-b4s48\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.582010 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.581912 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.585108 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.585065 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/13afbb97-4b5d-4235-8b7d-6e2eb9907052-tls-certs\") pod \"kube-auth-proxy-5d4b79bd44-srrnf\" (UID: \"13afbb97-4b5d-4235-8b7d-6e2eb9907052\") " pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.799980 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.799946 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" Jul 08 16:01:08.842600 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.842517 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x8gwf"] Jul 08 16:01:08.846152 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.846130 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:08.850031 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.849998 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 08 16:01:08.872425 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.872390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x8gwf"] Jul 08 16:01:08.885782 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.885713 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.888554 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.888499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c90e0a30-67af-4274-b56c-5f34d4bfab5d-cert\") pod \"odh-model-controller-7998c67dc4-bbj9x\" (UID: \"c90e0a30-67af-4274-b56c-5f34d4bfab5d\") " pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:08.972667 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.972645 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf"] Jul 08 16:01:08.974803 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:08.974759 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13afbb97_4b5d_4235_8b7d_6e2eb9907052.slice/crio-98d5688eb11bf4ce08e66ea7acf187681fa25f5cf694fba43df1f6dff494b977 WatchSource:0}: Error finding container 98d5688eb11bf4ce08e66ea7acf187681fa25f5cf694fba43df1f6dff494b977: Status 404 returned error can't find the container with id 98d5688eb11bf4ce08e66ea7acf187681fa25f5cf694fba43df1f6dff494b977 Jul 08 16:01:08.987295 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.987267 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59b2p\" (UniqueName: \"kubernetes.io/projected/18c98917-329a-4095-a65f-67bd77822d92-kube-api-access-59b2p\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:08.987667 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:08.987311 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18c98917-329a-4095-a65f-67bd77822d92-tls-certs\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.037580 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.037544 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:09.049227 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.049192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:09.091194 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.091053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59b2p\" (UniqueName: \"kubernetes.io/projected/18c98917-329a-4095-a65f-67bd77822d92-kube-api-access-59b2p\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.091194 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.091163 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18c98917-329a-4095-a65f-67bd77822d92-tls-certs\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.094764 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.094710 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18c98917-329a-4095-a65f-67bd77822d92-tls-certs\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.105640 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.105609 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59b2p\" (UniqueName: \"kubernetes.io/projected/18c98917-329a-4095-a65f-67bd77822d92-kube-api-access-59b2p\") pod \"model-serving-api-54d89bd5fc-x8gwf\" (UID: \"18c98917-329a-4095-a65f-67bd77822d92\") " pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.150954 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.150922 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:09.159902 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.159874 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:09.192408 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.192321 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-bbj9x"] Jul 08 16:01:09.194756 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:09.194717 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc90e0a30_67af_4274_b56c_5f34d4bfab5d.slice/crio-887b0132dd4b4d1d53c45ff7da78b580ebd5344ffe2736df0e9248909ae98c04 WatchSource:0}: Error finding container 887b0132dd4b4d1d53c45ff7da78b580ebd5344ffe2736df0e9248909ae98c04: Status 404 returned error can't find the container with id 887b0132dd4b4d1d53c45ff7da78b580ebd5344ffe2736df0e9248909ae98c04 Jul 08 16:01:09.322727 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.322700 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-x8gwf"] Jul 08 16:01:09.325618 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:09.325593 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c98917_329a_4095_a65f_67bd77822d92.slice/crio-a86ceb25b8b444556df7de5c4b729a7677268d286f44be8c7c066441dca26b7d WatchSource:0}: Error finding container a86ceb25b8b444556df7de5c4b729a7677268d286f44be8c7c066441dca26b7d: Status 404 returned error can't find the container with id a86ceb25b8b444556df7de5c4b729a7677268d286f44be8c7c066441dca26b7d Jul 08 16:01:09.755697 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.755661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" event={"ID":"18c98917-329a-4095-a65f-67bd77822d92","Type":"ContainerStarted","Data":"a86ceb25b8b444556df7de5c4b729a7677268d286f44be8c7c066441dca26b7d"} Jul 08 16:01:09.756854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.756831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" event={"ID":"c90e0a30-67af-4274-b56c-5f34d4bfab5d","Type":"ContainerStarted","Data":"887b0132dd4b4d1d53c45ff7da78b580ebd5344ffe2736df0e9248909ae98c04"} Jul 08 16:01:09.758028 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.758008 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" event={"ID":"13afbb97-4b5d-4235-8b7d-6e2eb9907052","Type":"ContainerStarted","Data":"98d5688eb11bf4ce08e66ea7acf187681fa25f5cf694fba43df1f6dff494b977"} Jul 08 16:01:09.772030 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.772002 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:09.790756 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.790730 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:09.793785 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.793770 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.797192 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.797166 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 08 16:01:09.797192 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.797186 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 16:01:09.797368 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.797171 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-khqrp\"" Jul 08 16:01:09.797463 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.797449 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 08 16:01:09.797520 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.797477 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 08 16:01:09.810451 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.810426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:09.867354 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.867287 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:09.898465 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898411 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898465 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898468 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898732 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898511 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898732 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898552 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898732 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898578 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6t75\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898732 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898609 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.898732 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.898671 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:09.999712 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999675 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999720 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999762 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999799 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999823 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6t75\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000244 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:09.999902 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.000945 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.000922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.002700 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.002660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.002861 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.002836 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.002999 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.002978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.003305 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.003283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.009598 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.009535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.009980 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.009952 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6t75\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75\") pod \"istiod-openshift-gateway-7574459656-qlsvn\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.104751 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.104716 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:10.304795 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.304744 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:10.309302 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:10.309272 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e461111_bcb4_4f7c_9a71_ae6760e6b137.slice/crio-5c97ea232e75aea12bb34a9afa2b3e17d6ee8103a2a14dcd1bdf3ba2e29228a6 WatchSource:0}: Error finding container 5c97ea232e75aea12bb34a9afa2b3e17d6ee8103a2a14dcd1bdf3ba2e29228a6: Status 404 returned error can't find the container with id 5c97ea232e75aea12bb34a9afa2b3e17d6ee8103a2a14dcd1bdf3ba2e29228a6 Jul 08 16:01:10.765216 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.765178 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" event={"ID":"6e461111-bcb4-4f7c-9a71-ae6760e6b137","Type":"ContainerStarted","Data":"5c97ea232e75aea12bb34a9afa2b3e17d6ee8103a2a14dcd1bdf3ba2e29228a6"} Jul 08 16:01:10.941859 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:10.941819 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:14.669051 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.669010 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:01:14.669369 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.669113 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:01:14.789427 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.789382 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" event={"ID":"13afbb97-4b5d-4235-8b7d-6e2eb9907052","Type":"ContainerStarted","Data":"84d3904a72d5df9f60c9ebb3ab92ca76004b3e45742d505b1e126654067041ba"} Jul 08 16:01:14.791919 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.791889 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" event={"ID":"6e461111-bcb4-4f7c-9a71-ae6760e6b137","Type":"ContainerStarted","Data":"b08dd50ad7d798b9c930174a5a61a63660a17da0931dbe18cf4fe71bcffa2bf6"} Jul 08 16:01:14.792645 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.792625 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:14.793681 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.793623 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" event={"ID":"18c98917-329a-4095-a65f-67bd77822d92","Type":"ContainerStarted","Data":"9a3d9389f1ae1d2db62f130f9231536715f86ef0cf68332d6cce2ceb4ccec6bf"} Jul 08 16:01:14.794152 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.794109 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:14.796022 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.795996 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" event={"ID":"c90e0a30-67af-4274-b56c-5f34d4bfab5d","Type":"ContainerStarted","Data":"7dd3b55eaed5139513e8b795aa2cb0c77a64448b5e976b3cec7d2b77753ab413"} Jul 08 16:01:14.796190 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.796144 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:14.861759 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.861707 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d4b79bd44-srrnf" podStartSLOduration=2.23973422 podStartE2EDuration="7.861690717s" totalImagesPullingTime="5.621956497s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:14.859043625 +0000 UTC m=+327.137139485" watchObservedRunningTime="2026-07-08 16:01:14.861690717 +0000 UTC m=+327.139786573" Jul 08 16:01:14.900925 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.900843 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" podStartSLOduration=1.543073225 podStartE2EDuration="5.900819111s" totalImagesPullingTime="4.357745886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:14.899653722 +0000 UTC m=+327.177749628" watchObservedRunningTime="2026-07-08 16:01:14.900819111 +0000 UTC m=+327.178914969" Jul 08 16:01:14.932753 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.932697 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" podStartSLOduration=1.531151468 podStartE2EDuration="6.93267998s" totalImagesPullingTime="5.401528512s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:14.93216492 +0000 UTC m=+327.210260806" watchObservedRunningTime="2026-07-08 16:01:14.93267998 +0000 UTC m=+327.210775888" Jul 08 16:01:14.966812 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:14.966755 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" podStartSLOduration=1.695825232 podStartE2EDuration="6.966732695s" totalImagesPullingTime="5.270907463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:14.965335646 +0000 UTC m=+327.243431525" watchObservedRunningTime="2026-07-08 16:01:14.966732695 +0000 UTC m=+327.244828556" Jul 08 16:01:15.599316 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:15.599278 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:15.701857 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:15.701827 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:15.802303 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:15.802270 2558 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-qlsvn container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 16:01:15.802451 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:15.802322 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 16:01:16.590437 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:16.590408 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:16.861876 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:16.861844 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:17.361854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:17.361815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:18.699289 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.699255 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:18.771881 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.771848 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lczld"] Jul 08 16:01:18.775448 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.775427 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:18.778428 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.778407 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 08 16:01:18.779298 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.779277 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-t77tx\"" Jul 08 16:01:18.784437 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.784413 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5"] Jul 08 16:01:18.787799 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.787782 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:18.790764 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.790742 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 16:01:18.791221 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.791201 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qmfwk\"" Jul 08 16:01:18.792740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.792689 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lczld"] Jul 08 16:01:18.801548 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.801528 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:18.818349 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.818320 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5"] Jul 08 16:01:18.826403 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.826373 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:18.891192 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.891143 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf2gx\" (UniqueName: \"kubernetes.io/projected/ee4b404e-e245-4793-93ca-1840b0bd4b19-kube-api-access-jf2gx\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:18.891501 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.891480 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfs88\" (UniqueName: \"kubernetes.io/projected/97f2fe57-a3f2-4021-a5aa-e095c14f4112-kube-api-access-dfs88\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:18.891800 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.891588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f2fe57-a3f2-4021-a5aa-e095c14f4112-cert\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:18.891800 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.891700 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:18.931853 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.931823 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:18.993150 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.993029 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfs88\" (UniqueName: \"kubernetes.io/projected/97f2fe57-a3f2-4021-a5aa-e095c14f4112-kube-api-access-dfs88\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:18.993150 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.993132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f2fe57-a3f2-4021-a5aa-e095c14f4112-cert\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:18.993346 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.993189 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:18.993346 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.993243 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf2gx\" (UniqueName: \"kubernetes.io/projected/ee4b404e-e245-4793-93ca-1840b0bd4b19-kube-api-access-jf2gx\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:18.993414 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:18.993339 2558 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 08 16:01:18.993451 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:01:18.993412 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert podName:ee4b404e-e245-4793-93ca-1840b0bd4b19 nodeName:}" failed. No retries permitted until 2026-07-08 16:01:19.493392557 +0000 UTC m=+331.771488392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert") pod "llmisvc-controller-manager-777c6bd7d5-crdq5" (UID: "ee4b404e-e245-4793-93ca-1840b0bd4b19") : secret "llmisvc-webhook-server-cert" not found Jul 08 16:01:18.995660 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:18.995640 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/97f2fe57-a3f2-4021-a5aa-e095c14f4112-cert\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:19.005364 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.005337 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfs88\" (UniqueName: \"kubernetes.io/projected/97f2fe57-a3f2-4021-a5aa-e095c14f4112-kube-api-access-dfs88\") pod \"kserve-controller-manager-d6f4b65b8-lczld\" (UID: \"97f2fe57-a3f2-4021-a5aa-e095c14f4112\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:19.005500 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.005481 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf2gx\" (UniqueName: \"kubernetes.io/projected/ee4b404e-e245-4793-93ca-1840b0bd4b19-kube-api-access-jf2gx\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:19.086696 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.086667 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:19.172920 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.172835 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:19.259589 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.259561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-lczld"] Jul 08 16:01:19.262042 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:19.262018 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f2fe57_a3f2_4021_a5aa_e095c14f4112.slice/crio-3af09519a1c34c8a03b8d7a737a79e3be236f51ff375f36b703fb5a25c9f87a3 WatchSource:0}: Error finding container 3af09519a1c34c8a03b8d7a737a79e3be236f51ff375f36b703fb5a25c9f87a3: Status 404 returned error can't find the container with id 3af09519a1c34c8a03b8d7a737a79e3be236f51ff375f36b703fb5a25c9f87a3 Jul 08 16:01:19.497609 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.497569 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:19.499945 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.499922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee4b404e-e245-4793-93ca-1840b0bd4b19-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-crdq5\" (UID: \"ee4b404e-e245-4793-93ca-1840b0bd4b19\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:19.697627 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.697593 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:19.823847 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.823819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" event={"ID":"97f2fe57-a3f2-4021-a5aa-e095c14f4112","Type":"ContainerStarted","Data":"3af09519a1c34c8a03b8d7a737a79e3be236f51ff375f36b703fb5a25c9f87a3"} Jul 08 16:01:19.849842 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:19.849815 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5"] Jul 08 16:01:19.851933 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:01:19.851903 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee4b404e_e245_4793_93ca_1840b0bd4b19.slice/crio-5215f236a1fb831d22f1d5da0621d1c575f164d90872da408f7eb193415b8844 WatchSource:0}: Error finding container 5215f236a1fb831d22f1d5da0621d1c575f164d90872da408f7eb193415b8844: Status 404 returned error can't find the container with id 5215f236a1fb831d22f1d5da0621d1c575f164d90872da408f7eb193415b8844 Jul 08 16:01:20.499853 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.499814 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:20.602348 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.602283 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:20.653672 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.653638 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:20.653915 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.653855 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerName="discovery" containerID="cri-o://b08dd50ad7d798b9c930174a5a61a63660a17da0931dbe18cf4fe71bcffa2bf6" gracePeriod=30 Jul 08 16:01:20.833309 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.833102 2558 generic.go:356] "Generic (PLEG): container finished" podID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerID="b08dd50ad7d798b9c930174a5a61a63660a17da0931dbe18cf4fe71bcffa2bf6" exitCode=0 Jul 08 16:01:20.833309 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.833249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" event={"ID":"6e461111-bcb4-4f7c-9a71-ae6760e6b137","Type":"ContainerDied","Data":"b08dd50ad7d798b9c930174a5a61a63660a17da0931dbe18cf4fe71bcffa2bf6"} Jul 08 16:01:20.834987 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.834926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" event={"ID":"ee4b404e-e245-4793-93ca-1840b0bd4b19","Type":"ContainerStarted","Data":"5215f236a1fb831d22f1d5da0621d1c575f164d90872da408f7eb193415b8844"} Jul 08 16:01:20.899356 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:20.899331 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:21.011386 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011352 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011395 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k6t75\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011435 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011464 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011515 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011563 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011561 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.011822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.011597 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts\") pod \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\" (UID: \"6e461111-bcb4-4f7c-9a71-ae6760e6b137\") " Jul 08 16:01:21.012156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.012111 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:01:21.014669 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.014373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:01:21.014669 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.014650 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts" (OuterVolumeSpecName: "cacerts") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:01:21.014854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.014669 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs" (OuterVolumeSpecName: "local-certs") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:01:21.014854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.014715 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75" (OuterVolumeSpecName: "kube-api-access-k6t75") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "kube-api-access-k6t75". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:01:21.014854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.014746 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:01:21.015187 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.015162 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "6e461111-bcb4-4f7c-9a71-ae6760e6b137" (UID: "6e461111-bcb4-4f7c-9a71-ae6760e6b137"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:01:21.112987 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.112951 2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-token\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.112987 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.112981 2558 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-cacerts\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.112987 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.112990 2558 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e461111-bcb4-4f7c-9a71-ae6760e6b137-local-certs\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.113236 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.113000 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k6t75\" (UniqueName: \"kubernetes.io/projected/6e461111-bcb4-4f7c-9a71-ae6760e6b137-kube-api-access-k6t75\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.113236 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.113011 2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-ca-configmap\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.113236 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.113019 2558 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-kubeconfig\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.113236 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.113027 2558 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6e461111-bcb4-4f7c-9a71-ae6760e6b137-istio-csr-dns-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:01:21.841896 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.841858 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" event={"ID":"6e461111-bcb4-4f7c-9a71-ae6760e6b137","Type":"ContainerDied","Data":"5c97ea232e75aea12bb34a9afa2b3e17d6ee8103a2a14dcd1bdf3ba2e29228a6"} Jul 08 16:01:21.842402 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.841903 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn" Jul 08 16:01:21.842402 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.841929 2558 scope.go:117] "RemoveContainer" containerID="b08dd50ad7d798b9c930174a5a61a63660a17da0931dbe18cf4fe71bcffa2bf6" Jul 08 16:01:21.891116 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.890590 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:21.898378 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:21.898327 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-qlsvn"] Jul 08 16:01:22.329843 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:22.329807 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" path="/var/lib/kubelet/pods/6e461111-bcb4-4f7c-9a71-ae6760e6b137/volumes" Jul 08 16:01:22.851174 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:22.851131 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" event={"ID":"97f2fe57-a3f2-4021-a5aa-e095c14f4112","Type":"ContainerStarted","Data":"5e378885bdc9bcfaa36b62dda7a53d41e4c0c3345ccfc29fa968fc71e6fb8269"} Jul 08 16:01:22.851572 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:22.851262 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:22.885286 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:22.885233 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" podStartSLOduration=1.382537602 podStartE2EDuration="4.885215699s" totalImagesPullingTime="3.502678097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:22.883494974 +0000 UTC m=+335.161590828" watchObservedRunningTime="2026-07-08 16:01:22.885215699 +0000 UTC m=+335.163311555" Jul 08 16:01:23.857136 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:23.857100 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" event={"ID":"ee4b404e-e245-4793-93ca-1840b0bd4b19","Type":"ContainerStarted","Data":"d3ce61290753b46341f0a89733ddba158144f81a26cda1508295cc8f5b12e4c4"} Jul 08 16:01:23.857517 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:23.857409 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:01:23.892263 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:23.892212 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" podStartSLOduration=2.023328303 podStartE2EDuration="5.892195042s" totalImagesPullingTime="3.868866739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:01:23.891254779 +0000 UTC m=+336.169350619" watchObservedRunningTime="2026-07-08 16:01:23.892195042 +0000 UTC m=+336.170290898" Jul 08 16:01:25.802666 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:25.802638 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-bbj9x" Jul 08 16:01:26.809853 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:26.809826 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-x8gwf" Jul 08 16:01:48.805947 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:48.805912 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:01:53.862640 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:53.862611 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-lczld" Jul 08 16:01:54.863645 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:01:54.863617 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-crdq5" Jul 08 16:02:08.532641 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.532607 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4s5v"] Jul 08 16:02:08.533025 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.532970 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerName="discovery" Jul 08 16:02:08.533025 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.532981 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerName="discovery" Jul 08 16:02:08.533117 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.533043 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e461111-bcb4-4f7c-9a71-ae6760e6b137" containerName="discovery" Jul 08 16:02:08.543514 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.543480 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:08.545958 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.545927 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4s5v"] Jul 08 16:02:08.546690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.546668 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 16:02:08.548336 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.548312 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-6wlxt\"" Jul 08 16:02:08.548437 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.548339 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 16:02:08.618622 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.618592 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6rtp\" (UniqueName: \"kubernetes.io/projected/24ed2509-2947-40c5-8672-ad55266b04ad-kube-api-access-x6rtp\") pod \"kuadrant-operator-catalog-m4s5v\" (UID: \"24ed2509-2947-40c5-8672-ad55266b04ad\") " pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:08.719705 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.719672 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6rtp\" (UniqueName: \"kubernetes.io/projected/24ed2509-2947-40c5-8672-ad55266b04ad-kube-api-access-x6rtp\") pod \"kuadrant-operator-catalog-m4s5v\" (UID: \"24ed2509-2947-40c5-8672-ad55266b04ad\") " pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:08.728524 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.728488 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6rtp\" (UniqueName: \"kubernetes.io/projected/24ed2509-2947-40c5-8672-ad55266b04ad-kube-api-access-x6rtp\") pod \"kuadrant-operator-catalog-m4s5v\" (UID: \"24ed2509-2947-40c5-8672-ad55266b04ad\") " pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:08.855377 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.855283 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:08.869539 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.869510 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:08.992096 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:08.992045 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-m4s5v"] Jul 08 16:02:08.995252 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:08.995214 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ed2509_2947_40c5_8672_ad55266b04ad.slice/crio-dbfd700208c2abff2c29ff07c55857ef59c53505dafb1685364def97ca82f745 WatchSource:0}: Error finding container dbfd700208c2abff2c29ff07c55857ef59c53505dafb1685364def97ca82f745: Status 404 returned error can't find the container with id dbfd700208c2abff2c29ff07c55857ef59c53505dafb1685364def97ca82f745 Jul 08 16:02:09.068289 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:09.068259 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:09.080216 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:09.080190 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" event={"ID":"24ed2509-2947-40c5-8672-ad55266b04ad","Type":"ContainerStarted","Data":"dbfd700208c2abff2c29ff07c55857ef59c53505dafb1685364def97ca82f745"} Jul 08 16:02:12.097182 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:12.097076 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" event={"ID":"24ed2509-2947-40c5-8672-ad55266b04ad","Type":"ContainerStarted","Data":"0b05c89fe62b95af455e749b79ebdcf2cc5b8ace26db4d9b6e3c130f202bb85f"} Jul 08 16:02:18.855582 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:18.855533 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:18.855582 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:18.855603 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:18.879035 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:18.879005 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:18.900139 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:18.900066 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" podStartSLOduration=8.074875832 podStartE2EDuration="10.900048815s" totalImagesPullingTime="2.825172983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:12.122749091 +0000 UTC m=+384.400844950" watchObservedRunningTime="2026-07-08 16:02:18.900048815 +0000 UTC m=+391.178144704" Jul 08 16:02:19.153523 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:19.153497 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-m4s5v" Jul 08 16:02:22.370524 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.370490 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4"] Jul 08 16:02:22.373366 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.373345 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.376462 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.376438 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfqs4\"" Jul 08 16:02:22.383843 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.383821 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4"] Jul 08 16:02:22.540526 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.540477 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgpbv\" (UniqueName: \"kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.540526 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.540527 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.540744 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.540603 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.641591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.641497 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgpbv\" (UniqueName: \"kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.641591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.641534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.641591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.641570 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.642053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.642032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.642053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.642044 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.650785 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.650768 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgpbv\" (UniqueName: \"kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.683241 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.683199 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:22.825760 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.825733 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4"] Jul 08 16:02:22.827595 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:22.827567 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb879b4db_3fbd_4b1e_8d9b_f808e6b70a4a.slice/crio-4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c WatchSource:0}: Error finding container 4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c: Status 404 returned error can't find the container with id 4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c Jul 08 16:02:22.975477 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.975444 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6"] Jul 08 16:02:22.977925 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.977910 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:22.989042 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:22.989017 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6"] Jul 08 16:02:23.145690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.145654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gvrt\" (UniqueName: \"kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.145840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.145740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.145840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.145813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.151053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.151026 2558 generic.go:356] "Generic (PLEG): container finished" podID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerID="bb9b60cddd4e2f67158b3ecd4fc2167b2080311d957db09b207cff93d2928e20" exitCode=0 Jul 08 16:02:23.151251 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.151116 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" event={"ID":"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a","Type":"ContainerDied","Data":"bb9b60cddd4e2f67158b3ecd4fc2167b2080311d957db09b207cff93d2928e20"} Jul 08 16:02:23.151251 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.151164 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" event={"ID":"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a","Type":"ContainerStarted","Data":"4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c"} Jul 08 16:02:23.247256 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.247172 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.247256 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.247224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.247444 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.247304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gvrt\" (UniqueName: \"kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.247598 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.247578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.247672 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.247652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.257837 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.257801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gvrt\" (UniqueName: \"kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.287644 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.287616 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:23.423151 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.423041 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6"] Jul 08 16:02:23.425239 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:23.425214 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81a8bb70_17a5_4823_8191_7b9d7809f826.slice/crio-6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b WatchSource:0}: Error finding container 6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b: Status 404 returned error can't find the container with id 6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b Jul 08 16:02:23.567806 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.567770 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9"] Jul 08 16:02:23.570268 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.570254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.583396 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.583376 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9"] Jul 08 16:02:23.650321 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.650289 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.650321 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.650325 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.650584 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.650453 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggs2v\" (UniqueName: \"kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.751468 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.751428 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggs2v\" (UniqueName: \"kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.751673 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.751486 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.751673 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.751511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.751942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.751923 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.751989 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.751931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.763401 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.763371 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggs2v\" (UniqueName: \"kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:23.881239 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:23.881206 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:24.012049 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.012024 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9"] Jul 08 16:02:24.014100 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:24.014058 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54b421ff_c64b_41dd_8e49_e45de3853701.slice/crio-df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710 WatchSource:0}: Error finding container df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710: Status 404 returned error can't find the container with id df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710 Jul 08 16:02:24.157755 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.157665 2558 generic.go:356] "Generic (PLEG): container finished" podID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerID="75510cca2969b333b8f07c0eadf8beefb2c1b053926c6700ac155b7b4f915f74" exitCode=0 Jul 08 16:02:24.157927 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.157761 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" event={"ID":"81a8bb70-17a5-4823-8191-7b9d7809f826","Type":"ContainerDied","Data":"75510cca2969b333b8f07c0eadf8beefb2c1b053926c6700ac155b7b4f915f74"} Jul 08 16:02:24.157927 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.157815 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" event={"ID":"81a8bb70-17a5-4823-8191-7b9d7809f826","Type":"ContainerStarted","Data":"6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b"} Jul 08 16:02:24.159515 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.159490 2558 generic.go:356] "Generic (PLEG): container finished" podID="54b421ff-c64b-41dd-8e49-e45de3853701" containerID="b12cdab8cf65164d81780425cd8de100bf1ca99fe427edaf2f70baf5f778d982" exitCode=0 Jul 08 16:02:24.159622 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.159525 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" event={"ID":"54b421ff-c64b-41dd-8e49-e45de3853701","Type":"ContainerDied","Data":"b12cdab8cf65164d81780425cd8de100bf1ca99fe427edaf2f70baf5f778d982"} Jul 08 16:02:24.159622 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.159561 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" event={"ID":"54b421ff-c64b-41dd-8e49-e45de3853701","Type":"ContainerStarted","Data":"df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710"} Jul 08 16:02:24.197291 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.197261 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5"] Jul 08 16:02:24.201214 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.201193 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.227328 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.227303 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5"] Jul 08 16:02:24.254649 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.254617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.254805 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.254701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4tz2\" (UniqueName: \"kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.254805 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.254734 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.355495 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.355459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4tz2\" (UniqueName: \"kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.355695 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.355503 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.355695 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.355643 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.355958 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.355939 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.356040 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.355937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.365481 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.365455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4tz2\" (UniqueName: \"kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.510292 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.510218 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:24.668759 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:24.668735 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5"] Jul 08 16:02:24.681128 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:24.681073 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd18fc9_b0c8_49a8_805d_0c75c08a71ef.slice/crio-28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7 WatchSource:0}: Error finding container 28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7: Status 404 returned error can't find the container with id 28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7 Jul 08 16:02:25.166460 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:25.166429 2558 generic.go:356] "Generic (PLEG): container finished" podID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerID="c20ed0cf3353abe8441272b5a9b18d8ccebe7b8be43966279a3bdf8c69b5ecbd" exitCode=0 Jul 08 16:02:25.166624 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:25.166517 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" event={"ID":"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a","Type":"ContainerDied","Data":"c20ed0cf3353abe8441272b5a9b18d8ccebe7b8be43966279a3bdf8c69b5ecbd"} Jul 08 16:02:25.167899 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:25.167877 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerID="40e343721495e29dbd4961ac9b5fbce275d0a4d1b0f6da06f47f596424ae9bae" exitCode=0 Jul 08 16:02:25.167995 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:25.167959 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" event={"ID":"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef","Type":"ContainerDied","Data":"40e343721495e29dbd4961ac9b5fbce275d0a4d1b0f6da06f47f596424ae9bae"} Jul 08 16:02:25.168033 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:25.167999 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" event={"ID":"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef","Type":"ContainerStarted","Data":"28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7"} Jul 08 16:02:26.175472 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.175438 2558 generic.go:356] "Generic (PLEG): container finished" podID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerID="f439f54c23b89ba741ed83b8b5ffc3fb51f274ab13d35044516240205b418481" exitCode=0 Jul 08 16:02:26.175910 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.175526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" event={"ID":"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a","Type":"ContainerDied","Data":"f439f54c23b89ba741ed83b8b5ffc3fb51f274ab13d35044516240205b418481"} Jul 08 16:02:26.177273 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.177249 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerID="82cbaf258d9a3e56c5caa9ff74893f8435377bcfaeda984131cc973b1959884d" exitCode=0 Jul 08 16:02:26.177379 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.177329 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" event={"ID":"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef","Type":"ContainerDied","Data":"82cbaf258d9a3e56c5caa9ff74893f8435377bcfaeda984131cc973b1959884d"} Jul 08 16:02:26.179284 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.179265 2558 generic.go:356] "Generic (PLEG): container finished" podID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerID="72332a402c6850ac840593ccfa951c1cf4bc386ce0c0bd2523fbc917f81c2bef" exitCode=0 Jul 08 16:02:26.179403 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.179381 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" event={"ID":"81a8bb70-17a5-4823-8191-7b9d7809f826","Type":"ContainerDied","Data":"72332a402c6850ac840593ccfa951c1cf4bc386ce0c0bd2523fbc917f81c2bef"} Jul 08 16:02:26.181271 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.181250 2558 generic.go:356] "Generic (PLEG): container finished" podID="54b421ff-c64b-41dd-8e49-e45de3853701" containerID="a60ca3edbbf043c342305c29a1a2eb02cbd3b673205f913c1a4d07ced7a6a257" exitCode=0 Jul 08 16:02:26.181344 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:26.181293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" event={"ID":"54b421ff-c64b-41dd-8e49-e45de3853701","Type":"ContainerDied","Data":"a60ca3edbbf043c342305c29a1a2eb02cbd3b673205f913c1a4d07ced7a6a257"} Jul 08 16:02:27.188791 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.188756 2558 generic.go:356] "Generic (PLEG): container finished" podID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerID="35068ff201c6d1163cc961946188339af11812bcf180e559d1d2206ebddd74eb" exitCode=0 Jul 08 16:02:27.189228 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.188820 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" event={"ID":"81a8bb70-17a5-4823-8191-7b9d7809f826","Type":"ContainerDied","Data":"35068ff201c6d1163cc961946188339af11812bcf180e559d1d2206ebddd74eb"} Jul 08 16:02:27.197222 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.197189 2558 generic.go:356] "Generic (PLEG): container finished" podID="54b421ff-c64b-41dd-8e49-e45de3853701" containerID="23311bef741860dcc76cb4340fdfb87194df172c4149bbff96db2fce042cf42e" exitCode=0 Jul 08 16:02:27.197409 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.197316 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" event={"ID":"54b421ff-c64b-41dd-8e49-e45de3853701","Type":"ContainerDied","Data":"23311bef741860dcc76cb4340fdfb87194df172c4149bbff96db2fce042cf42e"} Jul 08 16:02:27.199546 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.199525 2558 generic.go:356] "Generic (PLEG): container finished" podID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerID="f64569e95e9ad3b575655341cc2fb423de8adc86947635b2081f4037c605b459" exitCode=0 Jul 08 16:02:27.199639 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.199570 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" event={"ID":"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef","Type":"ContainerDied","Data":"f64569e95e9ad3b575655341cc2fb423de8adc86947635b2081f4037c605b459"} Jul 08 16:02:27.337494 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.337469 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:27.376720 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.376691 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle\") pod \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " Jul 08 16:02:27.376881 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.376731 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgpbv\" (UniqueName: \"kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv\") pod \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " Jul 08 16:02:27.377277 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.377253 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle" (OuterVolumeSpecName: "bundle") pod "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" (UID: "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:27.378892 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.378870 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv" (OuterVolumeSpecName: "kube-api-access-lgpbv") pod "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" (UID: "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a"). InnerVolumeSpecName "kube-api-access-lgpbv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:02:27.477688 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.477589 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util\") pod \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\" (UID: \"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a\") " Jul 08 16:02:27.477854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.477787 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:27.477854 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.477798 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgpbv\" (UniqueName: \"kubernetes.io/projected/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-kube-api-access-lgpbv\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:27.483469 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.483435 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util" (OuterVolumeSpecName: "util") pod "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" (UID: "b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:27.578274 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:27.578238 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.206627 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.206593 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" Jul 08 16:02:28.206627 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.206613 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4" event={"ID":"b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a","Type":"ContainerDied","Data":"4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c"} Jul 08 16:02:28.207050 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.206664 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4dbbcd9a71695bba9e5ca2bcbaac5bb6619b185f63071ab60c6a5cec0392d36c" Jul 08 16:02:28.363962 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.363939 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:28.394105 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.392634 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util\") pod \"54b421ff-c64b-41dd-8e49-e45de3853701\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " Jul 08 16:02:28.394105 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.392695 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle\") pod \"54b421ff-c64b-41dd-8e49-e45de3853701\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " Jul 08 16:02:28.394105 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.392745 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggs2v\" (UniqueName: \"kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v\") pod \"54b421ff-c64b-41dd-8e49-e45de3853701\" (UID: \"54b421ff-c64b-41dd-8e49-e45de3853701\") " Jul 08 16:02:28.396545 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.396488 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle" (OuterVolumeSpecName: "bundle") pod "54b421ff-c64b-41dd-8e49-e45de3853701" (UID: "54b421ff-c64b-41dd-8e49-e45de3853701"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.398534 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.398334 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v" (OuterVolumeSpecName: "kube-api-access-ggs2v") pod "54b421ff-c64b-41dd-8e49-e45de3853701" (UID: "54b421ff-c64b-41dd-8e49-e45de3853701"). InnerVolumeSpecName "kube-api-access-ggs2v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:02:28.403453 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.403421 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util" (OuterVolumeSpecName: "util") pod "54b421ff-c64b-41dd-8e49-e45de3853701" (UID: "54b421ff-c64b-41dd-8e49-e45de3853701"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.435701 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.435676 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:28.437775 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.437755 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:28.493690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493613 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle\") pod \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " Jul 08 16:02:28.493690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493676 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7gvrt\" (UniqueName: \"kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt\") pod \"81a8bb70-17a5-4823-8191-7b9d7809f826\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " Jul 08 16:02:28.493903 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493693 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4tz2\" (UniqueName: \"kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2\") pod \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " Jul 08 16:02:28.493903 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493733 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle\") pod \"81a8bb70-17a5-4823-8191-7b9d7809f826\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " Jul 08 16:02:28.493903 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493753 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util\") pod \"81a8bb70-17a5-4823-8191-7b9d7809f826\" (UID: \"81a8bb70-17a5-4823-8191-7b9d7809f826\") " Jul 08 16:02:28.493903 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.493781 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util\") pod \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\" (UID: \"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef\") " Jul 08 16:02:28.494124 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.494009 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggs2v\" (UniqueName: \"kubernetes.io/projected/54b421ff-c64b-41dd-8e49-e45de3853701-kube-api-access-ggs2v\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.494124 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.494026 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.494124 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.494041 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54b421ff-c64b-41dd-8e49-e45de3853701-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.494348 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.494321 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle" (OuterVolumeSpecName: "bundle") pod "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" (UID: "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.494438 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.494420 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle" (OuterVolumeSpecName: "bundle") pod "81a8bb70-17a5-4823-8191-7b9d7809f826" (UID: "81a8bb70-17a5-4823-8191-7b9d7809f826"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.495913 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.495892 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt" (OuterVolumeSpecName: "kube-api-access-7gvrt") pod "81a8bb70-17a5-4823-8191-7b9d7809f826" (UID: "81a8bb70-17a5-4823-8191-7b9d7809f826"). InnerVolumeSpecName "kube-api-access-7gvrt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:02:28.496181 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.496166 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2" (OuterVolumeSpecName: "kube-api-access-s4tz2") pod "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" (UID: "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef"). InnerVolumeSpecName "kube-api-access-s4tz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:02:28.502457 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.502414 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util" (OuterVolumeSpecName: "util") pod "81a8bb70-17a5-4823-8191-7b9d7809f826" (UID: "81a8bb70-17a5-4823-8191-7b9d7809f826"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.502672 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.502650 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util" (OuterVolumeSpecName: "util") pod "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" (UID: "dbd18fc9-b0c8-49a8-805d-0c75c08a71ef"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:02:28.594553 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594517 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.594553 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594547 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7gvrt\" (UniqueName: \"kubernetes.io/projected/81a8bb70-17a5-4823-8191-7b9d7809f826-kube-api-access-7gvrt\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.594553 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594558 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4tz2\" (UniqueName: \"kubernetes.io/projected/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-kube-api-access-s4tz2\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.594780 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594568 2558 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.594780 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594576 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/81a8bb70-17a5-4823-8191-7b9d7809f826-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.594780 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.594585 2558 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbd18fc9-b0c8-49a8-805d-0c75c08a71ef-util\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:02:28.833617 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.833532 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:28.935317 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:28.935282 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:29.214004 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.213976 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" Jul 08 16:02:29.214004 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.213985 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5" event={"ID":"dbd18fc9-b0c8-49a8-805d-0c75c08a71ef","Type":"ContainerDied","Data":"28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7"} Jul 08 16:02:29.214506 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.214029 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="28e45d5c5cd7357f2415987892165efd703d01c1f367ef19f86edd4f71896da7" Jul 08 16:02:29.216010 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.215984 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" event={"ID":"81a8bb70-17a5-4823-8191-7b9d7809f826","Type":"ContainerDied","Data":"6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b"} Jul 08 16:02:29.216010 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.216011 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6" Jul 08 16:02:29.216199 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.216021 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c938054078316d4c8315a3b0cd998e9411521bdd4118b65d6372f58e0150a2b" Jul 08 16:02:29.217848 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.217830 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" event={"ID":"54b421ff-c64b-41dd-8e49-e45de3853701","Type":"ContainerDied","Data":"df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710"} Jul 08 16:02:29.217930 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.217859 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df62c4fc3f9a5b5b5d5ec14d84c064b4ac51c0712cae7e24fe1555444312f710" Jul 08 16:02:29.217930 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:29.217836 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9" Jul 08 16:02:30.441257 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:30.441224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:31.054734 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:31.054702 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:31.579694 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:31.579661 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:31.687569 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:31.687535 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:34.706649 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.706617 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-stgnf"] Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.706965 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.706976 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.706982 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="extract" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.706988 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="extract" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707000 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="extract" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707005 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="extract" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707014 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707019 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707026 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707031 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707037 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707042 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="util" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707050 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="pull" Jul 08 16:02:34.707053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707055 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707063 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707068 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707075 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707104 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707110 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707117 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707124 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707129 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707138 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707143 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="pull" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707195 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707202 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbd18fc9-b0c8-49a8-805d-0c75c08a71ef" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707210 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="54b421ff-c64b-41dd-8e49-e45de3853701" containerName="extract" Jul 08 16:02:34.707747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.707216 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="81a8bb70-17a5-4823-8191-7b9d7809f826" containerName="extract" Jul 08 16:02:34.711545 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.711529 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:34.715603 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.715583 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zjk72\"" Jul 08 16:02:34.744445 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.744418 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr84n\" (UniqueName: \"kubernetes.io/projected/bed1e1bd-bb5a-4cd9-8556-25ad94b26059-kube-api-access-sr84n\") pod \"authorino-operator-75cc8d5cb7-stgnf\" (UID: \"bed1e1bd-bb5a-4cd9-8556-25ad94b26059\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:34.746173 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.746152 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-stgnf"] Jul 08 16:02:34.845459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.845429 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr84n\" (UniqueName: \"kubernetes.io/projected/bed1e1bd-bb5a-4cd9-8556-25ad94b26059-kube-api-access-sr84n\") pod \"authorino-operator-75cc8d5cb7-stgnf\" (UID: \"bed1e1bd-bb5a-4cd9-8556-25ad94b26059\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:34.866721 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:34.866688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr84n\" (UniqueName: \"kubernetes.io/projected/bed1e1bd-bb5a-4cd9-8556-25ad94b26059-kube-api-access-sr84n\") pod \"authorino-operator-75cc8d5cb7-stgnf\" (UID: \"bed1e1bd-bb5a-4cd9-8556-25ad94b26059\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:35.021833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:35.021738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:35.179564 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:35.179540 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-stgnf"] Jul 08 16:02:35.181340 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:35.181313 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed1e1bd_bb5a_4cd9_8556_25ad94b26059.slice/crio-b3ec2809ce0252760b15abbcfbc5398030c07f5e4daccfe83ce4dc4c7c18d957 WatchSource:0}: Error finding container b3ec2809ce0252760b15abbcfbc5398030c07f5e4daccfe83ce4dc4c7c18d957: Status 404 returned error can't find the container with id b3ec2809ce0252760b15abbcfbc5398030c07f5e4daccfe83ce4dc4c7c18d957 Jul 08 16:02:35.250288 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:35.250257 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" event={"ID":"bed1e1bd-bb5a-4cd9-8556-25ad94b26059","Type":"ContainerStarted","Data":"b3ec2809ce0252760b15abbcfbc5398030c07f5e4daccfe83ce4dc4c7c18d957"} Jul 08 16:02:35.483059 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:35.483017 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:37.239304 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.239260 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw"] Jul 08 16:02:37.252538 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.252503 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:37.257383 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.257362 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-pmvn5\"" Jul 08 16:02:37.262924 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.262803 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw"] Jul 08 16:02:37.267098 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.267060 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvk64\" (UniqueName: \"kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64\") pod \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" (UID: \"0ead140c-a7a8-4102-a3e3-38f9ea563553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:37.367647 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.367610 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvk64\" (UniqueName: \"kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64\") pod \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" (UID: \"0ead140c-a7a8-4102-a3e3-38f9ea563553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:37.387001 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.386972 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvk64\" (UniqueName: \"kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64\") pod \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" (UID: \"0ead140c-a7a8-4102-a3e3-38f9ea563553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:37.567728 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.567628 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:37.726042 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.726017 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw"] Jul 08 16:02:37.822453 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:37.822359 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:37.878367 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:37.878337 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ead140c_a7a8_4102_a3e3_38f9ea563553.slice/crio-2b40f55b51e339fa111dc6e54044b40851963f5e4a94433c74948b21841ad3f7 WatchSource:0}: Error finding container 2b40f55b51e339fa111dc6e54044b40851963f5e4a94433c74948b21841ad3f7: Status 404 returned error can't find the container with id 2b40f55b51e339fa111dc6e54044b40851963f5e4a94433c74948b21841ad3f7 Jul 08 16:02:38.105183 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:38.105092 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:38.271756 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:38.271722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" event={"ID":"0ead140c-a7a8-4102-a3e3-38f9ea563553","Type":"ContainerStarted","Data":"2b40f55b51e339fa111dc6e54044b40851963f5e4a94433c74948b21841ad3f7"} Jul 08 16:02:38.273240 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:38.273219 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" event={"ID":"bed1e1bd-bb5a-4cd9-8556-25ad94b26059","Type":"ContainerStarted","Data":"637420175f60e1b05dc96fa18f0ae507f43745aaab2c0b2c26cf392180f61909"} Jul 08 16:02:38.273365 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:38.273334 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:38.312334 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:38.312284 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" podStartSLOduration=1.564812544 podStartE2EDuration="4.312265116s" totalImagesPullingTime="2.747452572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:38.308195273 +0000 UTC m=+410.586291131" watchObservedRunningTime="2026-07-08 16:02:38.312265116 +0000 UTC m=+410.590360973" Jul 08 16:02:39.290599 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:39.290556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:40.288533 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:40.288446 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" event={"ID":"0ead140c-a7a8-4102-a3e3-38f9ea563553","Type":"ContainerStarted","Data":"4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a"} Jul 08 16:02:40.288533 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:40.288503 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:40.308267 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:40.308216 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" podStartSLOduration=1.219591202 podStartE2EDuration="3.308193675s" totalImagesPullingTime="2.088602473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:40.307467299 +0000 UTC m=+412.585563193" watchObservedRunningTime="2026-07-08 16:02:40.308193675 +0000 UTC m=+412.586289524" Jul 08 16:02:41.224759 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.224723 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q"] Jul 08 16:02:41.228209 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.228191 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.231527 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.231499 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-v528n\"" Jul 08 16:02:41.250962 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.250931 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q"] Jul 08 16:02:41.303122 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.303091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlz4p\" (UniqueName: \"kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.303122 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.303121 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.403813 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.403784 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlz4p\" (UniqueName: \"kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.404273 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.403816 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.404273 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.404258 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.422483 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.422458 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlz4p\" (UniqueName: \"kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p\") pod \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.539039 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.538950 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:41.731058 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.731029 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q"] Jul 08 16:02:41.733933 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:41.733905 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7458ef07_5a3e_4bdc_a1df_84687f7fa4b0.slice/crio-3a02eaad4ac3716370376deb5e23bce70146617eac47bd0998097da616ca98d1 WatchSource:0}: Error finding container 3a02eaad4ac3716370376deb5e23bce70146617eac47bd0998097da616ca98d1: Status 404 returned error can't find the container with id 3a02eaad4ac3716370376deb5e23bce70146617eac47bd0998097da616ca98d1 Jul 08 16:02:41.896233 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:41.896202 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:42.090670 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:42.090636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:42.300186 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:42.300073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" event={"ID":"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0","Type":"ContainerStarted","Data":"3a02eaad4ac3716370376deb5e23bce70146617eac47bd0998097da616ca98d1"} Jul 08 16:02:43.628345 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.628310 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9"] Jul 08 16:02:43.636612 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.636591 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:43.639842 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.639817 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zq8ch\"" Jul 08 16:02:43.639991 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.639966 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 08 16:02:43.648071 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.648049 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9"] Jul 08 16:02:43.721661 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.721628 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njcwk\" (UniqueName: \"kubernetes.io/projected/901187b0-450d-4be1-a483-bf7a94041f1b-kube-api-access-njcwk\") pod \"dns-operator-controller-manager-864dd78c4c-trjl9\" (UID: \"901187b0-450d-4be1-a483-bf7a94041f1b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:43.823001 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.822968 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njcwk\" (UniqueName: \"kubernetes.io/projected/901187b0-450d-4be1-a483-bf7a94041f1b-kube-api-access-njcwk\") pod \"dns-operator-controller-manager-864dd78c4c-trjl9\" (UID: \"901187b0-450d-4be1-a483-bf7a94041f1b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:43.843415 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.843385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njcwk\" (UniqueName: \"kubernetes.io/projected/901187b0-450d-4be1-a483-bf7a94041f1b-kube-api-access-njcwk\") pod \"dns-operator-controller-manager-864dd78c4c-trjl9\" (UID: \"901187b0-450d-4be1-a483-bf7a94041f1b\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:43.948344 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:43.948264 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:44.120096 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:44.120054 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9"] Jul 08 16:02:44.122135 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:44.122045 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901187b0_450d_4be1_a483_bf7a94041f1b.slice/crio-88285b8872975f9655b3773798faff1b698bdd1d050fb6b76fe0d533928fe938 WatchSource:0}: Error finding container 88285b8872975f9655b3773798faff1b698bdd1d050fb6b76fe0d533928fe938: Status 404 returned error can't find the container with id 88285b8872975f9655b3773798faff1b698bdd1d050fb6b76fe0d533928fe938 Jul 08 16:02:44.312407 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:44.312324 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" event={"ID":"901187b0-450d-4be1-a483-bf7a94041f1b","Type":"ContainerStarted","Data":"88285b8872975f9655b3773798faff1b698bdd1d050fb6b76fe0d533928fe938"} Jul 08 16:02:44.945437 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:44.945376 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:45.214450 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:45.214348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:45.517906 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:45.517785 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:47.334199 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:47.334098 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" event={"ID":"901187b0-450d-4be1-a483-bf7a94041f1b","Type":"ContainerStarted","Data":"f175bf33bf7188be22ca957e7acf83137d94a385681f46a5f986adb966b0d59b"} Jul 08 16:02:47.334199 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:47.334164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:02:47.380011 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:47.379953 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" podStartSLOduration=1.4535614620000001 podStartE2EDuration="4.379937787s" totalImagesPullingTime="2.926376325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:47.378990591 +0000 UTC m=+419.657086461" watchObservedRunningTime="2026-07-08 16:02:47.379937787 +0000 UTC m=+419.658033641" Jul 08 16:02:48.957668 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:48.957636 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:49.151972 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:49.151940 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:49.283566 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:49.283535 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-stgnf" Jul 08 16:02:49.347560 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:49.347531 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" event={"ID":"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0","Type":"ContainerStarted","Data":"cecf07a34788dcb747c553dc860e92796880c6ce4dac08200c1255486326017b"} Jul 08 16:02:49.347706 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:49.347650 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:02:49.390366 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:49.390319 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" podStartSLOduration=0.948509807 podStartE2EDuration="8.390302439s" totalImagesPullingTime="7.441792632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:02:49.388856734 +0000 UTC m=+421.666952610" watchObservedRunningTime="2026-07-08 16:02:49.390302439 +0000 UTC m=+421.668398375" Jul 08 16:02:51.296627 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:51.296600 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:02:52.319286 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.319248 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:52.454706 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.454669 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg"] Jul 08 16:02:52.458326 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.458307 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.464551 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.464529 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 08 16:02:52.464678 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.464591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 08 16:02:52.464678 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.464599 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nfqs4\"" Jul 08 16:02:52.477942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.477915 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg"] Jul 08 16:02:52.506918 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.506886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8f5d1c-961e-4219-a4fb-093dedc12a04-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.506918 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.506921 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qq5t\" (UniqueName: \"kubernetes.io/projected/ff8f5d1c-961e-4219-a4fb-093dedc12a04-kube-api-access-9qq5t\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.507159 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.507028 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff8f5d1c-961e-4219-a4fb-093dedc12a04-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.514069 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.514043 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:52.607539 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.607512 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8f5d1c-961e-4219-a4fb-093dedc12a04-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.607731 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.607549 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qq5t\" (UniqueName: \"kubernetes.io/projected/ff8f5d1c-961e-4219-a4fb-093dedc12a04-kube-api-access-9qq5t\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.607731 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.607608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff8f5d1c-961e-4219-a4fb-093dedc12a04-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.608235 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.608215 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ff8f5d1c-961e-4219-a4fb-093dedc12a04-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.609969 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.609946 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ff8f5d1c-961e-4219-a4fb-093dedc12a04-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.617801 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.617774 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qq5t\" (UniqueName: \"kubernetes.io/projected/ff8f5d1c-961e-4219-a4fb-093dedc12a04-kube-api-access-9qq5t\") pod \"kuadrant-console-plugin-66b5774985-d7btg\" (UID: \"ff8f5d1c-961e-4219-a4fb-093dedc12a04\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.618245 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.618223 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:02:52.768007 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.767978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" Jul 08 16:02:52.935450 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:52.935426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg"] Jul 08 16:02:52.937196 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:02:52.937164 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff8f5d1c_961e_4219_a4fb_093dedc12a04.slice/crio-9fdff9e4592e46f7726d0edadfd04bc3ec05550ab0a12743bcb975d108c1f23c WatchSource:0}: Error finding container 9fdff9e4592e46f7726d0edadfd04bc3ec05550ab0a12743bcb975d108c1f23c: Status 404 returned error can't find the container with id 9fdff9e4592e46f7726d0edadfd04bc3ec05550ab0a12743bcb975d108c1f23c Jul 08 16:02:53.372710 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:53.372677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" event={"ID":"ff8f5d1c-961e-4219-a4fb-093dedc12a04","Type":"ContainerStarted","Data":"9fdff9e4592e46f7726d0edadfd04bc3ec05550ab0a12743bcb975d108c1f23c"} Jul 08 16:02:58.342174 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:02:58.342145 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-trjl9" Jul 08 16:03:00.356000 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:00.355966 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:03:01.881031 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:01.880947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:01.961121 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:01.961067 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6"] Jul 08 16:03:01.965039 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:01.965012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:01.978936 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:01.978737 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:01.981179 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:01.981153 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6"] Jul 08 16:03:02.097469 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.097427 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.097648 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.097553 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxpp\" (UniqueName: \"kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.198410 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.198319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.198410 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.198391 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxpp\" (UniqueName: \"kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.198707 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.198685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.210632 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.210600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxpp\" (UniqueName: \"kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp\") pod \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.268703 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.268671 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6"] Jul 08 16:03:02.269011 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.268991 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:02.273058 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.273030 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6"] Jul 08 16:03:02.288506 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.288473 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q"] Jul 08 16:03:02.288757 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.288723 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" containerName="manager" containerID="cri-o://cecf07a34788dcb747c553dc860e92796880c6ce4dac08200c1255486326017b" gracePeriod=2 Jul 08 16:03:02.291842 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.291817 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:02.298635 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.298433 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.303267 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.303208 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q"] Jul 08 16:03:02.317161 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.315972 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:02.319067 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.319046 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw"] Jul 08 16:03:02.319365 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.319314 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" containerName="manager" containerID="cri-o://4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a" gracePeriod=2 Jul 08 16:03:02.331777 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.331750 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:02.332351 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.332331 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" containerName="manager" Jul 08 16:03:02.332351 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.332353 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" containerName="manager" Jul 08 16:03:02.332550 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.332456 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" containerName="manager" Jul 08 16:03:02.336070 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.336048 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw"] Jul 08 16:03:02.336224 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.336181 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.338836 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:02.338782 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-75b4q\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:03:02.341682 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:02.341650 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:02.342448 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.342426 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:02.349525 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.349500 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc"] Jul 08 16:03:02.349985 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.349968 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" containerName="manager" Jul 08 16:03:02.349985 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.349987 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" containerName="manager" Jul 08 16:03:02.350175 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.350122 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" containerName="manager" Jul 08 16:03:02.353253 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.353234 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:02.371153 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.371120 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc"] Jul 08 16:03:02.394881 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:02.394850 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:02.400371 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.400347 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.400504 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.400409 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6zkb\" (UniqueName: \"kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.400559 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.400509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.400559 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.400533 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2j8j\" (UniqueName: \"kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.433317 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.433288 2558 generic.go:356] "Generic (PLEG): container finished" podID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" containerID="cecf07a34788dcb747c553dc860e92796880c6ce4dac08200c1255486326017b" exitCode=0 Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.501871 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.501921 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2j8j\" (UniqueName: \"kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.502033 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggwc9\" (UniqueName: \"kubernetes.io/projected/d19bb065-aeae-46d4-b545-862ff72cc1e5-kube-api-access-ggwc9\") pod \"limitador-operator-controller-manager-859d7b78bd-89msc\" (UID: \"d19bb065-aeae-46d4-b545-862ff72cc1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.502065 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.502152 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6zkb\" (UniqueName: \"kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.502928 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.502870 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.503379 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.502990 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.520620 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.520563 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6zkb\" (UniqueName: \"kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb\") pod \"kuadrant-operator-controller-manager-55467d9f7-cmldm\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.520766 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.520686 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2j8j\" (UniqueName: \"kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2mrzs\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.569055 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.569026 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:03:02.571979 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:02.571941 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:02.577950 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.577928 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:02.580700 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:02.580664 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:02.603384 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.603343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggwc9\" (UniqueName: \"kubernetes.io/projected/d19bb065-aeae-46d4-b545-862ff72cc1e5-kube-api-access-ggwc9\") pod \"limitador-operator-controller-manager-859d7b78bd-89msc\" (UID: \"d19bb065-aeae-46d4-b545-862ff72cc1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:02.626958 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.626931 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggwc9\" (UniqueName: \"kubernetes.io/projected/d19bb065-aeae-46d4-b545-862ff72cc1e5-kube-api-access-ggwc9\") pod \"limitador-operator-controller-manager-859d7b78bd-89msc\" (UID: \"d19bb065-aeae-46d4-b545-862ff72cc1e5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:02.704595 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.704565 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume\") pod \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " Jul 08 16:03:02.704775 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.704666 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvk64\" (UniqueName: \"kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64\") pod \"0ead140c-a7a8-4102-a3e3-38f9ea563553\" (UID: \"0ead140c-a7a8-4102-a3e3-38f9ea563553\") " Jul 08 16:03:02.704775 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.704708 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlz4p\" (UniqueName: \"kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p\") pod \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\" (UID: \"7458ef07-5a3e-4bdc-a1df-84687f7fa4b0\") " Jul 08 16:03:02.705114 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.705069 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" (UID: "7458ef07-5a3e-4bdc-a1df-84687f7fa4b0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:03:02.706718 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.706694 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64" (OuterVolumeSpecName: "kube-api-access-rvk64") pod "0ead140c-a7a8-4102-a3e3-38f9ea563553" (UID: "0ead140c-a7a8-4102-a3e3-38f9ea563553"). InnerVolumeSpecName "kube-api-access-rvk64". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:03:02.706886 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.706857 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p" (OuterVolumeSpecName: "kube-api-access-rlz4p") pod "7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" (UID: "7458ef07-5a3e-4bdc-a1df-84687f7fa4b0"). InnerVolumeSpecName "kube-api-access-rlz4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:03:02.728973 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.728944 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:02.739162 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.739141 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:02.747829 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.747764 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:02.806251 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.806217 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvk64\" (UniqueName: \"kubernetes.io/projected/0ead140c-a7a8-4102-a3e3-38f9ea563553-kube-api-access-rvk64\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:02.806251 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.806253 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlz4p\" (UniqueName: \"kubernetes.io/projected/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-kube-api-access-rlz4p\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:02.806490 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:02.806270 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0-extensions-socket-volume\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:03.441943 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:03.441890 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-75b4q" Jul 08 16:03:03.441943 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:03.441917 2558 scope.go:117] "RemoveContainer" containerID="cecf07a34788dcb747c553dc860e92796880c6ce4dac08200c1255486326017b" Jul 08 16:03:03.443876 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:03.443849 2558 generic.go:356] "Generic (PLEG): container finished" podID="0ead140c-a7a8-4102-a3e3-38f9ea563553" containerID="4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a" exitCode=0 Jul 08 16:03:03.443996 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:03.443943 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:03.445353 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:03.445325 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:03.447838 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:03.447810 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:03.458404 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:03.458365 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:03.460785 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:03.460758 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-cxsxw\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-cxsxw" Jul 08 16:03:04.329593 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:04.329554 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ead140c-a7a8-4102-a3e3-38f9ea563553" path="/var/lib/kubelet/pods/0ead140c-a7a8-4102-a3e3-38f9ea563553/volumes" Jul 08 16:03:04.329930 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:04.329916 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7458ef07-5a3e-4bdc-a1df-84687f7fa4b0" path="/var/lib/kubelet/pods/7458ef07-5a3e-4bdc-a1df-84687f7fa4b0/volumes" Jul 08 16:03:07.231434 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:07.231405 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:07.333201 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:07.333156 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:07.826069 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:07.826033 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:07.926602 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:07.926567 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:12.086848 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:12.086730 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:12.182873 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:12.182839 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:15.637383 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:15.637348 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:15.698997 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:15.698963 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:16.988408 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:16.988173 2558 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-7hvr6_kuadrant-system_b160ce31-df67-4e3e-9940-41bb0c722740_0(300c528b722f15a66f64719277aa7ad24c6cc97df7fd20396cced0b1b45d9940): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-7hvr6 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" Jul 08 16:03:16.988408 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:16.988248 2558 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-7hvr6_kuadrant-system_b160ce31-df67-4e3e-9940-41bb0c722740_0(300c528b722f15a66f64719277aa7ad24c6cc97df7fd20396cced0b1b45d9940): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-7hvr6 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:16.994310 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:16.994280 2558 scope.go:117] "RemoveContainer" containerID="4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a" Jul 08 16:03:17.034201 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.034178 2558 scope.go:117] "RemoveContainer" containerID="4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a" Jul 08 16:03:17.034571 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:17.034546 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a\": container with ID starting with 4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a not found: ID does not exist" containerID="4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a" Jul 08 16:03:17.034728 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.034579 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a"} err="failed to get container status \"4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a\": rpc error: code = NotFound desc = could not find container \"4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a\": container with ID starting with 4087d690fcceafe21589687f4c2212eb2961e94a1f21744760ce5e2c1241254a not found: ID does not exist" Jul 08 16:03:17.232517 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.228316 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:17.233667 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:03:17.232584 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca7eba2_5d6d_4eb6_bab7_9e78f9561ab1.slice/crio-455d9d251364d6c699bbae35bff4ab20aab647964c567a0c07672debfa4714bd WatchSource:0}: Error finding container 455d9d251364d6c699bbae35bff4ab20aab647964c567a0c07672debfa4714bd: Status 404 returned error can't find the container with id 455d9d251364d6c699bbae35bff4ab20aab647964c567a0c07672debfa4714bd Jul 08 16:03:17.454975 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.454948 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc"] Jul 08 16:03:17.456953 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:03:17.456931 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19bb065_aeae_46d4_b545_862ff72cc1e5.slice/crio-5126e6754ce6503e1b16bced5e5be197f19d99f3a537c699f3aaba4e48a20c90 WatchSource:0}: Error finding container 5126e6754ce6503e1b16bced5e5be197f19d99f3a537c699f3aaba4e48a20c90: Status 404 returned error can't find the container with id 5126e6754ce6503e1b16bced5e5be197f19d99f3a537c699f3aaba4e48a20c90 Jul 08 16:03:17.510598 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.510576 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:17.512975 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:03:17.512947 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19b1c3d2_aade_460f_8673_0cdc42aa8994.slice/crio-fa1e096c716cecce229c8909a3d50749057bdab7e0ffc9aa6747fd7037f1af27 WatchSource:0}: Error finding container fa1e096c716cecce229c8909a3d50749057bdab7e0ffc9aa6747fd7037f1af27: Status 404 returned error can't find the container with id fa1e096c716cecce229c8909a3d50749057bdab7e0ffc9aa6747fd7037f1af27 Jul 08 16:03:17.532686 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.532654 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" event={"ID":"ff8f5d1c-961e-4219-a4fb-093dedc12a04","Type":"ContainerStarted","Data":"53e923605857806adb994114fcc7564097d48f4a4c47a798cfd44fe189aae8fa"} Jul 08 16:03:17.534393 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.534368 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" event={"ID":"d19bb065-aeae-46d4-b545-862ff72cc1e5","Type":"ContainerStarted","Data":"b7bc26466b4dfde7e5ceb13832d9caf6be35818a8ddf25a68e038ce73fae2bee"} Jul 08 16:03:17.534516 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.534419 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" event={"ID":"d19bb065-aeae-46d4-b545-862ff72cc1e5","Type":"ContainerStarted","Data":"5126e6754ce6503e1b16bced5e5be197f19d99f3a537c699f3aaba4e48a20c90"} Jul 08 16:03:17.534516 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.534450 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:17.536943 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.536918 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" event={"ID":"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1","Type":"ContainerStarted","Data":"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9"} Jul 08 16:03:17.537053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.536971 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" event={"ID":"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1","Type":"ContainerStarted","Data":"455d9d251364d6c699bbae35bff4ab20aab647964c567a0c07672debfa4714bd"} Jul 08 16:03:17.537053 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.537002 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:17.538379 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.538354 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" event={"ID":"19b1c3d2-aade-460f-8673-0cdc42aa8994","Type":"ContainerStarted","Data":"fa1e096c716cecce229c8909a3d50749057bdab7e0ffc9aa6747fd7037f1af27"} Jul 08 16:03:17.539629 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.539608 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:17.554361 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.554339 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:17.570841 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.570795 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d7btg" podStartSLOduration=1.4367704510000001 podStartE2EDuration="25.570779413s" totalImagesPullingTime="24.134008962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:02:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:17.56850696 +0000 UTC m=+449.846602842" watchObservedRunningTime="2026-07-08 16:03:17.570779413 +0000 UTC m=+449.848875269" Jul 08 16:03:17.606318 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.606266 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" podStartSLOduration=15.606246182 podStartE2EDuration="15.606246182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:17.604928905 +0000 UTC m=+449.883024763" watchObservedRunningTime="2026-07-08 16:03:17.606246182 +0000 UTC m=+449.884342039" Jul 08 16:03:17.608708 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:17.608674 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="b160ce31-df67-4e3e-9940-41bb0c722740" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:17.639904 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.639847 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" podStartSLOduration=15.639830577 podStartE2EDuration="15.639830577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:17.637522789 +0000 UTC m=+449.915618647" watchObservedRunningTime="2026-07-08 16:03:17.639830577 +0000 UTC m=+449.917926433" Jul 08 16:03:17.649610 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.649586 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume\") pod \"b160ce31-df67-4e3e-9940-41bb0c722740\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " Jul 08 16:03:17.649760 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.649620 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxpp\" (UniqueName: \"kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp\") pod \"b160ce31-df67-4e3e-9940-41bb0c722740\" (UID: \"b160ce31-df67-4e3e-9940-41bb0c722740\") " Jul 08 16:03:17.649885 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.649862 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b160ce31-df67-4e3e-9940-41bb0c722740" (UID: "b160ce31-df67-4e3e-9940-41bb0c722740"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:03:17.651638 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.651610 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp" (OuterVolumeSpecName: "kube-api-access-2qxpp") pod "b160ce31-df67-4e3e-9940-41bb0c722740" (UID: "b160ce31-df67-4e3e-9940-41bb0c722740"). InnerVolumeSpecName "kube-api-access-2qxpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:03:17.751050 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.750961 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b160ce31-df67-4e3e-9940-41bb0c722740-extensions-socket-volume\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:17.751050 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:17.750991 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxpp\" (UniqueName: \"kubernetes.io/projected/b160ce31-df67-4e3e-9940-41bb0c722740-kube-api-access-2qxpp\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:18.329545 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:18.329467 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b160ce31-df67-4e3e-9940-41bb0c722740" path="/var/lib/kubelet/pods/b160ce31-df67-4e3e-9940-41bb0c722740/volumes" Jul 08 16:03:18.335234 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:18.335205 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="b160ce31-df67-4e3e-9940-41bb0c722740" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:18.547116 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:18.547066 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" event={"ID":"19b1c3d2-aade-460f-8673-0cdc42aa8994","Type":"ContainerStarted","Data":"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a"} Jul 08 16:03:18.547319 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:18.547164 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:18.547519 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:18.547499 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:18.570583 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:18.570552 2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7hvr6\" is forbidden: User \"system:node:ip-10-0-128-249.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-249.ec2.internal' and this object" podUID="b160ce31-df67-4e3e-9940-41bb0c722740" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7hvr6" Jul 08 16:03:18.571901 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:18.571865 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" podStartSLOduration=16.571851339 podStartE2EDuration="16.571851339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:18.568061483 +0000 UTC m=+450.846157340" watchObservedRunningTime="2026-07-08 16:03:18.571851339 +0000 UTC m=+450.849947195" Jul 08 16:03:20.153617 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:20.153585 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:20.254799 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:20.254769 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:21.693717 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:21.693680 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:21.793970 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:21.793935 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:28.549060 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.549024 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-89msc" Jul 08 16:03:28.549624 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.549322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:28.622211 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.622175 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:28.622470 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.622437 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" podUID="19b1c3d2-aade-460f-8673-0cdc42aa8994" containerName="manager" containerID="cri-o://e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a" gracePeriod=10 Jul 08 16:03:28.624356 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.624336 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:28.875043 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.875018 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:28.955344 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.955313 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2j8j\" (UniqueName: \"kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j\") pod \"19b1c3d2-aade-460f-8673-0cdc42aa8994\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " Jul 08 16:03:28.955344 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.955349 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume\") pod \"19b1c3d2-aade-460f-8673-0cdc42aa8994\" (UID: \"19b1c3d2-aade-460f-8673-0cdc42aa8994\") " Jul 08 16:03:28.955795 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.955764 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "19b1c3d2-aade-460f-8673-0cdc42aa8994" (UID: "19b1c3d2-aade-460f-8673-0cdc42aa8994"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:03:28.957369 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:28.957349 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j" (OuterVolumeSpecName: "kube-api-access-v2j8j") pod "19b1c3d2-aade-460f-8673-0cdc42aa8994" (UID: "19b1c3d2-aade-460f-8673-0cdc42aa8994"). InnerVolumeSpecName "kube-api-access-v2j8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:03:29.056572 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.056532 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2j8j\" (UniqueName: \"kubernetes.io/projected/19b1c3d2-aade-460f-8673-0cdc42aa8994-kube-api-access-v2j8j\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:29.056572 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.056563 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/19b1c3d2-aade-460f-8673-0cdc42aa8994-extensions-socket-volume\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:29.608629 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.608581 2558 generic.go:356] "Generic (PLEG): container finished" podID="19b1c3d2-aade-460f-8673-0cdc42aa8994" containerID="e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a" exitCode=0 Jul 08 16:03:29.608629 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.608630 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" Jul 08 16:03:29.609205 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.608658 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" event={"ID":"19b1c3d2-aade-460f-8673-0cdc42aa8994","Type":"ContainerDied","Data":"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a"} Jul 08 16:03:29.609205 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.608711 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs" event={"ID":"19b1c3d2-aade-460f-8673-0cdc42aa8994","Type":"ContainerDied","Data":"fa1e096c716cecce229c8909a3d50749057bdab7e0ffc9aa6747fd7037f1af27"} Jul 08 16:03:29.609205 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.608733 2558 scope.go:117] "RemoveContainer" containerID="e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a" Jul 08 16:03:29.618286 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.618275 2558 scope.go:117] "RemoveContainer" containerID="e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a" Jul 08 16:03:29.618534 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:29.618512 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a\": container with ID starting with e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a not found: ID does not exist" containerID="e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a" Jul 08 16:03:29.618578 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.618546 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a"} err="failed to get container status \"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a\": rpc error: code = NotFound desc = could not find container \"e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a\": container with ID starting with e2a77e9c5775ecdd225c16748f4ac473798f018c510c29835fa93289d252c70a not found: ID does not exist" Jul 08 16:03:29.632231 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.632209 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:29.639677 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:29.639657 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2mrzs"] Jul 08 16:03:30.328750 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:30.328719 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19b1c3d2-aade-460f-8673-0cdc42aa8994" path="/var/lib/kubelet/pods/19b1c3d2-aade-460f-8673-0cdc42aa8994/volumes" Jul 08 16:03:45.024274 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.024242 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk"] Jul 08 16:03:45.024690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.024630 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19b1c3d2-aade-460f-8673-0cdc42aa8994" containerName="manager" Jul 08 16:03:45.024690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.024641 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="19b1c3d2-aade-460f-8673-0cdc42aa8994" containerName="manager" Jul 08 16:03:45.024761 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.024700 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="19b1c3d2-aade-460f-8673-0cdc42aa8994" containerName="manager" Jul 08 16:03:45.066017 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.065982 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:45.070830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.070620 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk"] Jul 08 16:03:45.070830 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.070760 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.074747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.074721 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-psv6w\"" Jul 08 16:03:45.075233 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.075216 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 16:03:45.205165 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205133 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205165 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205169 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205423 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205199 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205423 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205423 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205334 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205423 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205391 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lqfg\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-kube-api-access-9lqfg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205579 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205431 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205579 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.205579 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.205515 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306685 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306592 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306685 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306685 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306663 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lqfg\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-kube-api-access-9lqfg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306841 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.306977 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.306857 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.307359 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.307288 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.307418 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.307355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.307418 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.307377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.307496 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.307427 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.307496 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.307431 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.309145 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.309123 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.309325 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.309307 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.319537 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.319516 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lqfg\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-kube-api-access-9lqfg\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.319664 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.319642 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd474187-f44c-47dc-b917-2ee3fa25ba5e-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-ck4tk\" (UID: \"dd474187-f44c-47dc-b917-2ee3fa25ba5e\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.381891 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.381856 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:45.524255 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.524232 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk"] Jul 08 16:03:45.526071 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:03:45.526043 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd474187_f44c_47dc_b917_2ee3fa25ba5e.slice/crio-bc6e8ff5a749a3091f3e4163ae2b60957e84a896fc8305ca5c08483939b6dd0f WatchSource:0}: Error finding container bc6e8ff5a749a3091f3e4163ae2b60957e84a896fc8305ca5c08483939b6dd0f: Status 404 returned error can't find the container with id bc6e8ff5a749a3091f3e4163ae2b60957e84a896fc8305ca5c08483939b6dd0f Jul 08 16:03:45.702602 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:45.702571 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" event={"ID":"dd474187-f44c-47dc-b917-2ee3fa25ba5e","Type":"ContainerStarted","Data":"bc6e8ff5a749a3091f3e4163ae2b60957e84a896fc8305ca5c08483939b6dd0f"} Jul 08 16:03:46.003545 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.003460 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:46.223493 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.223463 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:46.223952 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.223672 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" podUID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" containerName="manager" containerID="cri-o://93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9" gracePeriod=10 Jul 08 16:03:46.498458 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.498433 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:46.628412 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.628373 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6zkb\" (UniqueName: \"kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb\") pod \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " Jul 08 16:03:46.628412 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.628420 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume\") pod \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\" (UID: \"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1\") " Jul 08 16:03:46.628878 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.628848 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" (UID: "cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 16:03:46.630525 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.630503 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb" (OuterVolumeSpecName: "kube-api-access-g6zkb") pod "cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" (UID: "cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1"). InnerVolumeSpecName "kube-api-access-g6zkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:03:46.709838 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.709804 2558 generic.go:356] "Generic (PLEG): container finished" podID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" containerID="93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9" exitCode=0 Jul 08 16:03:46.710007 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.709856 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" Jul 08 16:03:46.710007 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.709870 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" event={"ID":"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1","Type":"ContainerDied","Data":"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9"} Jul 08 16:03:46.710007 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.709911 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm" event={"ID":"cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1","Type":"ContainerDied","Data":"455d9d251364d6c699bbae35bff4ab20aab647964c567a0c07672debfa4714bd"} Jul 08 16:03:46.710007 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.709932 2558 scope.go:117] "RemoveContainer" containerID="93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9" Jul 08 16:03:46.719492 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.719476 2558 scope.go:117] "RemoveContainer" containerID="93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9" Jul 08 16:03:46.719796 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:03:46.719779 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9\": container with ID starting with 93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9 not found: ID does not exist" containerID="93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9" Jul 08 16:03:46.719850 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.719806 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9"} err="failed to get container status \"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9\": rpc error: code = NotFound desc = could not find container \"93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9\": container with ID starting with 93e1a32a920babbdb4c085bc6dadbfb85bc406bf28fb8ec1ad8355048f8362b9 not found: ID does not exist" Jul 08 16:03:46.728971 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.728944 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6zkb\" (UniqueName: \"kubernetes.io/projected/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-kube-api-access-g6zkb\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:46.728971 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.728966 2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1-extensions-socket-volume\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:03:46.734377 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.734352 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:46.738502 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:46.738476 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-cmldm"] Jul 08 16:03:48.330418 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:48.330383 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" path="/var/lib/kubelet/pods/cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1/volumes" Jul 08 16:03:48.702073 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:48.702033 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:03:48.702207 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:48.702118 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:03:48.702207 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:48.702152 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:03:49.730943 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:49.730909 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" event={"ID":"dd474187-f44c-47dc-b917-2ee3fa25ba5e","Type":"ContainerStarted","Data":"6299d786a2751ecd1a9ad77353f04284bb547109e9eb66e8a85c87c27b2cafcd"} Jul 08 16:03:49.754459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:49.754408 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podStartSLOduration=2.580800173 podStartE2EDuration="5.754392753s" totalImagesPullingTime="3.17359258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:49.751794784 +0000 UTC m=+482.029890658" watchObservedRunningTime="2026-07-08 16:03:49.754392753 +0000 UTC m=+482.032488610" Jul 08 16:03:50.382734 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.382698 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:50.387390 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.387364 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:50.736409 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.736327 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:50.737278 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.737261 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:03:50.757422 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.757391 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55fc65969c-zplwq"] Jul 08 16:03:50.757772 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.757759 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" containerName="manager" Jul 08 16:03:50.757825 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.757773 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" containerName="manager" Jul 08 16:03:50.757865 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.757849 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="cca7eba2-5d6d-4eb6-bab7-9e78f9561ab1" containerName="manager" Jul 08 16:03:50.772954 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.772929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.774959 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.774929 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fc65969c-zplwq"] Jul 08 16:03:50.821301 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.821273 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:03:50.868267 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-oauth-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868267 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868272 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-service-ca\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868492 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-oauth-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868492 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868376 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868492 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868395 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-trusted-ca-bundle\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868492 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.868658 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.868512 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8d95\" (UniqueName: \"kubernetes.io/projected/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-kube-api-access-h8d95\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970168 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970129 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970168 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8d95\" (UniqueName: \"kubernetes.io/projected/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-kube-api-access-h8d95\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970413 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970212 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-oauth-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970413 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970232 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-service-ca\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970413 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970246 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-oauth-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970413 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970288 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970609 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970457 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-trusted-ca-bundle\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.970998 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.970971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.971148 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.971124 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-service-ca\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.971209 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.971162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-oauth-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.971312 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.971294 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-trusted-ca-bundle\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.972672 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.972650 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-serving-cert\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.972789 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.972702 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-console-oauth-config\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:50.979537 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:50.979515 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8d95\" (UniqueName: \"kubernetes.io/projected/bb889c8d-ed66-472e-9cfb-9c766c6c4a17-kube-api-access-h8d95\") pod \"console-55fc65969c-zplwq\" (UID: \"bb889c8d-ed66-472e-9cfb-9c766c6c4a17\") " pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:51.084886 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:51.084799 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:03:51.224049 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:51.224024 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55fc65969c-zplwq"] Jul 08 16:03:51.225714 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:03:51.225685 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb889c8d_ed66_472e_9cfb_9c766c6c4a17.slice/crio-6e96d066279c5932ea762e18cc170b2feede9a886c979e5ebc3ba59930a560b3 WatchSource:0}: Error finding container 6e96d066279c5932ea762e18cc170b2feede9a886c979e5ebc3ba59930a560b3: Status 404 returned error can't find the container with id 6e96d066279c5932ea762e18cc170b2feede9a886c979e5ebc3ba59930a560b3 Jul 08 16:03:51.743510 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:51.743476 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fc65969c-zplwq" event={"ID":"bb889c8d-ed66-472e-9cfb-9c766c6c4a17","Type":"ContainerStarted","Data":"dcda53b20dbba088f3118b972bfeb87f3bb2b7a563274f8916b20894af3b2371"} Jul 08 16:03:51.743922 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:51.743526 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55fc65969c-zplwq" event={"ID":"bb889c8d-ed66-472e-9cfb-9c766c6c4a17","Type":"ContainerStarted","Data":"6e96d066279c5932ea762e18cc170b2feede9a886c979e5ebc3ba59930a560b3"} Jul 08 16:03:51.763778 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:03:51.763721 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55fc65969c-zplwq" podStartSLOduration=1.76370346 podStartE2EDuration="1.76370346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:03:51.762788826 +0000 UTC m=+484.040884702" watchObservedRunningTime="2026-07-08 16:03:51.76370346 +0000 UTC m=+484.041799318" Jul 08 16:04:01.085355 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:01.085322 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:04:01.085964 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:01.085392 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:04:01.090207 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:01.090183 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:04:01.801602 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:01.801575 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55fc65969c-zplwq" Jul 08 16:04:01.862951 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:01.862913 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 16:04:02.011712 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:02.011678 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:02.119591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:02.119556 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:03.111123 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.111073 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:03.117015 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.116990 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:03.120806 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.120787 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.125139 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.125121 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 08 16:04:03.132404 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.132379 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:03.185547 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.185516 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.185729 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.185571 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.211283 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.211235 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:03.221920 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.221892 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:03.287226 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.287187 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.287226 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.287239 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.287858 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.287829 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.297025 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.296995 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq\") pod \"limitador-limitador-64c94fd64f-njqw9\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.403670 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.403591 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:03.433605 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.433568 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:03.581118 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.581095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:03.582689 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:04:03.582661 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aa0207f_b895_4702_8f1a_5b908642f17a.slice/crio-ffdbf8d8f23a1190807d5b26aa1ae9432faf883365777aad5bb2e7b091ed091e WatchSource:0}: Error finding container ffdbf8d8f23a1190807d5b26aa1ae9432faf883365777aad5bb2e7b091ed091e: Status 404 returned error can't find the container with id ffdbf8d8f23a1190807d5b26aa1ae9432faf883365777aad5bb2e7b091ed091e Jul 08 16:04:03.613587 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.613558 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:04:03.618279 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.618261 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.637270 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.637241 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:04:03.673396 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.673307 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:04:03.692182 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.692149 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz2cf\" (UniqueName: \"kubernetes.io/projected/c498ec80-adcc-4622-bd59-ef8ab89dace6-kube-api-access-zz2cf\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.692353 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.692187 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c498ec80-adcc-4622-bd59-ef8ab89dace6-config-file\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.793774 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.793738 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz2cf\" (UniqueName: \"kubernetes.io/projected/c498ec80-adcc-4622-bd59-ef8ab89dace6-kube-api-access-zz2cf\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.793774 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.793777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c498ec80-adcc-4622-bd59-ef8ab89dace6-config-file\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.794400 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.794383 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c498ec80-adcc-4622-bd59-ef8ab89dace6-config-file\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.802840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.802819 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz2cf\" (UniqueName: \"kubernetes.io/projected/c498ec80-adcc-4622-bd59-ef8ab89dace6-kube-api-access-zz2cf\") pod \"limitador-limitador-54d6d988d5-fbbp6\" (UID: \"c498ec80-adcc-4622-bd59-ef8ab89dace6\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.808907 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.808876 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" event={"ID":"2aa0207f-b895-4702-8f1a-5b908642f17a","Type":"ContainerStarted","Data":"ffdbf8d8f23a1190807d5b26aa1ae9432faf883365777aad5bb2e7b091ed091e"} Jul 08 16:04:03.935500 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.935401 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:03.935657 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.935530 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:03.939006 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.938871 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:03.941955 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.941933 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ql768\"" Jul 08 16:04:03.946872 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.946844 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:03.983067 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.983035 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:03.995458 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:03.995430 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmt5h\" (UniqueName: \"kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h\") pod \"authorino-58cd955675-74qkw\" (UID: \"dc3b7104-f692-41b1-a7c5-374f779735ed\") " pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:04.089861 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.089834 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:04:04.090794 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.090762 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:04.090893 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:04:04.090799 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc498ec80_adcc_4622_bd59_ef8ab89dace6.slice/crio-db5acaaba07cb59f96d1914729fe546d32bde6c3f051bedaf1085a3d7ad32d3d WatchSource:0}: Error finding container db5acaaba07cb59f96d1914729fe546d32bde6c3f051bedaf1085a3d7ad32d3d: Status 404 returned error can't find the container with id db5acaaba07cb59f96d1914729fe546d32bde6c3f051bedaf1085a3d7ad32d3d Jul 08 16:04:04.096170 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.096149 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmt5h\" (UniqueName: \"kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h\") pod \"authorino-58cd955675-74qkw\" (UID: \"dc3b7104-f692-41b1-a7c5-374f779735ed\") " pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:04.105969 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.105941 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmt5h\" (UniqueName: \"kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h\") pod \"authorino-58cd955675-74qkw\" (UID: \"dc3b7104-f692-41b1-a7c5-374f779735ed\") " pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:04.250151 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.250047 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:04.436692 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.436663 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:04.444311 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:04:04.444267 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc3b7104_f692_41b1_a7c5_374f779735ed.slice/crio-7b3faaa6f3e29b4ec0a246b4298226e1c7eec1aed14b00a0bfb7f165000dd718 WatchSource:0}: Error finding container 7b3faaa6f3e29b4ec0a246b4298226e1c7eec1aed14b00a0bfb7f165000dd718: Status 404 returned error can't find the container with id 7b3faaa6f3e29b4ec0a246b4298226e1c7eec1aed14b00a0bfb7f165000dd718 Jul 08 16:04:04.818251 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.818215 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-74qkw" event={"ID":"dc3b7104-f692-41b1-a7c5-374f779735ed","Type":"ContainerStarted","Data":"7b3faaa6f3e29b4ec0a246b4298226e1c7eec1aed14b00a0bfb7f165000dd718"} Jul 08 16:04:04.819743 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:04.819711 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" event={"ID":"c498ec80-adcc-4622-bd59-ef8ab89dace6","Type":"ContainerStarted","Data":"db5acaaba07cb59f96d1914729fe546d32bde6c3f051bedaf1085a3d7ad32d3d"} Jul 08 16:04:08.433272 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.433205 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:08.851565 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.851519 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-74qkw" event={"ID":"dc3b7104-f692-41b1-a7c5-374f779735ed","Type":"ContainerStarted","Data":"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79"} Jul 08 16:04:08.851565 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.851549 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-74qkw" podUID="dc3b7104-f692-41b1-a7c5-374f779735ed" containerName="authorino" containerID="cri-o://d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79" gracePeriod=30 Jul 08 16:04:08.853546 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.853511 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" event={"ID":"2aa0207f-b895-4702-8f1a-5b908642f17a","Type":"ContainerStarted","Data":"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887"} Jul 08 16:04:08.853695 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.853582 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:08.855458 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.855436 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" event={"ID":"c498ec80-adcc-4622-bd59-ef8ab89dace6","Type":"ContainerStarted","Data":"2676a3b1ee03f4c813d1b43f0caa77bc15d7459a4863abacd63aa443d070e595"} Jul 08 16:04:08.855579 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.855520 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:08.872434 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.872389 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-74qkw" podStartSLOduration=1.650873525 podStartE2EDuration="5.872371833s" totalImagesPullingTime="4.221498308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:08.86920754 +0000 UTC m=+501.147303409" watchObservedRunningTime="2026-07-08 16:04:08.872371833 +0000 UTC m=+501.150467689" Jul 08 16:04:08.894840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.894764 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" podStartSLOduration=0.811997462 podStartE2EDuration="5.894737065s" totalImagesPullingTime="5.082739603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:08.889441189 +0000 UTC m=+501.167537072" watchObservedRunningTime="2026-07-08 16:04:08.894737065 +0000 UTC m=+501.172832923" Jul 08 16:04:08.917884 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:08.917831 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" podStartSLOduration=1.335860734 podStartE2EDuration="5.917813826s" totalImagesPullingTime="4.581953092s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:08.917298004 +0000 UTC m=+501.195393863" watchObservedRunningTime="2026-07-08 16:04:08.917813826 +0000 UTC m=+501.195909682" Jul 08 16:04:09.093961 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.093937 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:09.148047 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.148015 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmt5h\" (UniqueName: \"kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h\") pod \"dc3b7104-f692-41b1-a7c5-374f779735ed\" (UID: \"dc3b7104-f692-41b1-a7c5-374f779735ed\") " Jul 08 16:04:09.149967 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.149937 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h" (OuterVolumeSpecName: "kube-api-access-xmt5h") pod "dc3b7104-f692-41b1-a7c5-374f779735ed" (UID: "dc3b7104-f692-41b1-a7c5-374f779735ed"). InnerVolumeSpecName "kube-api-access-xmt5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:09.248972 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.248879 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmt5h\" (UniqueName: \"kubernetes.io/projected/dc3b7104-f692-41b1-a7c5-374f779735ed-kube-api-access-xmt5h\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:09.862285 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.862251 2558 generic.go:356] "Generic (PLEG): container finished" podID="dc3b7104-f692-41b1-a7c5-374f779735ed" containerID="d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79" exitCode=0 Jul 08 16:04:09.862740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.862296 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-74qkw" Jul 08 16:04:09.862740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.862334 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-74qkw" event={"ID":"dc3b7104-f692-41b1-a7c5-374f779735ed","Type":"ContainerDied","Data":"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79"} Jul 08 16:04:09.862740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.862379 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-74qkw" event={"ID":"dc3b7104-f692-41b1-a7c5-374f779735ed","Type":"ContainerDied","Data":"7b3faaa6f3e29b4ec0a246b4298226e1c7eec1aed14b00a0bfb7f165000dd718"} Jul 08 16:04:09.862740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.862401 2558 scope.go:117] "RemoveContainer" containerID="d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79" Jul 08 16:04:09.872310 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.872292 2558 scope.go:117] "RemoveContainer" containerID="d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79" Jul 08 16:04:09.872563 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:09.872542 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79\": container with ID starting with d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79 not found: ID does not exist" containerID="d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79" Jul 08 16:04:09.872608 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.872571 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79"} err="failed to get container status \"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79\": rpc error: code = NotFound desc = could not find container \"d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79\": container with ID starting with d723f928220e051ea17ce366c9ce83f84efe842cc782ddbc642a654e83745a79 not found: ID does not exist" Jul 08 16:04:09.884895 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.884861 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:09.888706 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:09.888684 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-74qkw"] Jul 08 16:04:10.328619 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:10.328589 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc3b7104-f692-41b1-a7c5-374f779735ed" path="/var/lib/kubelet/pods/dc3b7104-f692-41b1-a7c5-374f779735ed/volumes" Jul 08 16:04:19.863164 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:19.863134 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fbbp6" Jul 08 16:04:19.863565 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:19.863201 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:19.926780 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:19.926750 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:19.926991 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:19.926968 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" podUID="2aa0207f-b895-4702-8f1a-5b908642f17a" containerName="limitador" containerID="cri-o://c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887" gracePeriod=30 Jul 08 16:04:20.481218 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.481187 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:20.552302 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.552213 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq\") pod \"2aa0207f-b895-4702-8f1a-5b908642f17a\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " Jul 08 16:04:20.552489 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.552323 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file\") pod \"2aa0207f-b895-4702-8f1a-5b908642f17a\" (UID: \"2aa0207f-b895-4702-8f1a-5b908642f17a\") " Jul 08 16:04:20.552721 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.552696 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file" (OuterVolumeSpecName: "config-file") pod "2aa0207f-b895-4702-8f1a-5b908642f17a" (UID: "2aa0207f-b895-4702-8f1a-5b908642f17a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:04:20.554356 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.554326 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq" (OuterVolumeSpecName: "kube-api-access-kkvjq") pod "2aa0207f-b895-4702-8f1a-5b908642f17a" (UID: "2aa0207f-b895-4702-8f1a-5b908642f17a"). InnerVolumeSpecName "kube-api-access-kkvjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:20.653144 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.653110 2558 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2aa0207f-b895-4702-8f1a-5b908642f17a-config-file\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:20.653144 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.653139 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkvjq\" (UniqueName: \"kubernetes.io/projected/2aa0207f-b895-4702-8f1a-5b908642f17a-kube-api-access-kkvjq\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:20.925342 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.925305 2558 generic.go:356] "Generic (PLEG): container finished" podID="2aa0207f-b895-4702-8f1a-5b908642f17a" containerID="c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887" exitCode=0 Jul 08 16:04:20.925342 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.925345 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" event={"ID":"2aa0207f-b895-4702-8f1a-5b908642f17a","Type":"ContainerDied","Data":"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887"} Jul 08 16:04:20.925840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.925351 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" Jul 08 16:04:20.925840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.925387 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-njqw9" event={"ID":"2aa0207f-b895-4702-8f1a-5b908642f17a","Type":"ContainerDied","Data":"ffdbf8d8f23a1190807d5b26aa1ae9432faf883365777aad5bb2e7b091ed091e"} Jul 08 16:04:20.925840 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.925414 2558 scope.go:117] "RemoveContainer" containerID="c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887" Jul 08 16:04:20.935670 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.935475 2558 scope.go:117] "RemoveContainer" containerID="c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887" Jul 08 16:04:20.935764 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:20.935749 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887\": container with ID starting with c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887 not found: ID does not exist" containerID="c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887" Jul 08 16:04:20.935808 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.935774 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887"} err="failed to get container status \"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887\": rpc error: code = NotFound desc = could not find container \"c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887\": container with ID starting with c4f4467fd3b666fc7be29598719a4d42638adebb02731591bc0193e6c9fb3887 not found: ID does not exist" Jul 08 16:04:20.952790 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.952759 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:20.957305 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:20.957280 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-njqw9"] Jul 08 16:04:22.329031 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.328996 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aa0207f-b895-4702-8f1a-5b908642f17a" path="/var/lib/kubelet/pods/2aa0207f-b895-4702-8f1a-5b908642f17a/volumes" Jul 08 16:04:22.704267 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.704232 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:22.913373 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913334 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9"] Jul 08 16:04:22.913803 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913778 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc3b7104-f692-41b1-a7c5-374f779735ed" containerName="authorino" Jul 08 16:04:22.913803 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913796 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc3b7104-f692-41b1-a7c5-374f779735ed" containerName="authorino" Jul 08 16:04:22.913921 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913817 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aa0207f-b895-4702-8f1a-5b908642f17a" containerName="limitador" Jul 08 16:04:22.913921 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913824 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aa0207f-b895-4702-8f1a-5b908642f17a" containerName="limitador" Jul 08 16:04:22.913921 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913887 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aa0207f-b895-4702-8f1a-5b908642f17a" containerName="limitador" Jul 08 16:04:22.913921 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.913899 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc3b7104-f692-41b1-a7c5-374f779735ed" containerName="authorino" Jul 08 16:04:22.918226 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.918207 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:22.921539 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.921519 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 16:04:22.921663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.921526 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 16:04:22.922945 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.922930 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 16:04:22.923044 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.922950 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-qmqmp\"" Jul 08 16:04:22.928496 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:22.928476 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9"] Jul 08 16:04:23.074500 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.074399 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq2m6\" (UniqueName: \"kubernetes.io/projected/42e908ab-7f27-4858-a5ea-f55520e01d47-kube-api-access-hq2m6\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.074668 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.074524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42e908ab-7f27-4858-a5ea-f55520e01d47-data\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.144547 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.144511 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:23.175833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.175805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42e908ab-7f27-4858-a5ea-f55520e01d47-data\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.175933 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.175879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq2m6\" (UniqueName: \"kubernetes.io/projected/42e908ab-7f27-4858-a5ea-f55520e01d47-kube-api-access-hq2m6\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.176214 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.176195 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/42e908ab-7f27-4858-a5ea-f55520e01d47-data\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.193384 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.193359 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq2m6\" (UniqueName: \"kubernetes.io/projected/42e908ab-7f27-4858-a5ea-f55520e01d47-kube-api-access-hq2m6\") pod \"postgres-69fb4594cf-lg6f9\" (UID: \"42e908ab-7f27-4858-a5ea-f55520e01d47\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.229199 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.229166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:23.245297 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.245265 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:23.366833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.366811 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9"] Jul 08 16:04:23.368824 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:04:23.368798 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e908ab_7f27_4858_a5ea_f55520e01d47.slice/crio-c068e580848fea0548176674a9aab64689ab7bee26f7a03725ca20e4204898d6 WatchSource:0}: Error finding container c068e580848fea0548176674a9aab64689ab7bee26f7a03725ca20e4204898d6: Status 404 returned error can't find the container with id c068e580848fea0548176674a9aab64689ab7bee26f7a03725ca20e4204898d6 Jul 08 16:04:23.952375 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:23.952338 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" event={"ID":"42e908ab-7f27-4858-a5ea-f55520e01d47","Type":"ContainerStarted","Data":"c068e580848fea0548176674a9aab64689ab7bee26f7a03725ca20e4204898d6"} Jul 08 16:04:26.889158 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:26.889070 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8489fb5596-hgsd7" podUID="7deee5a3-e270-4155-bbcc-f67ddf701762" containerName="console" containerID="cri-o://e786a18d5e280248d548b6f9415225fa5d80557f9f970340858ad06ef886e4cc" gracePeriod=15 Jul 08 16:04:27.982598 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:27.982560 2558 generic.go:356] "Generic (PLEG): container finished" podID="7deee5a3-e270-4155-bbcc-f67ddf701762" containerID="e786a18d5e280248d548b6f9415225fa5d80557f9f970340858ad06ef886e4cc" exitCode=0 Jul 08 16:04:27.983050 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:27.982623 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489fb5596-hgsd7" event={"ID":"7deee5a3-e270-4155-bbcc-f67ddf701762","Type":"ContainerDied","Data":"e786a18d5e280248d548b6f9415225fa5d80557f9f970340858ad06ef886e4cc"} Jul 08 16:04:28.329458 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.329432 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 16:04:28.428687 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.428666 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.428804 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.428694 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.428804 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.428713 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.428888 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.428842 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.428888 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.428878 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.429022 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429002 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.429180 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429070 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qcdps\" (UniqueName: \"kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps\") pod \"7deee5a3-e270-4155-bbcc-f67ddf701762\" (UID: \"7deee5a3-e270-4155-bbcc-f67ddf701762\") " Jul 08 16:04:28.429288 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429076 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:04:28.429351 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429117 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config" (OuterVolumeSpecName: "console-config") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:04:28.429351 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429116 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca" (OuterVolumeSpecName: "service-ca") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:04:28.429516 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429494 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 16:04:28.429573 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429544 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-oauth-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.429573 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429566 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-service-ca\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.429674 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.429580 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-console-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.431228 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.431205 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:04:28.431519 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.431494 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:04:28.431609 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.431579 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps" (OuterVolumeSpecName: "kube-api-access-qcdps") pod "7deee5a3-e270-4155-bbcc-f67ddf701762" (UID: "7deee5a3-e270-4155-bbcc-f67ddf701762"). InnerVolumeSpecName "kube-api-access-qcdps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:28.530107 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.530049 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-serving-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.530107 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.530094 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7deee5a3-e270-4155-bbcc-f67ddf701762-console-oauth-config\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.530107 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.530106 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7deee5a3-e270-4155-bbcc-f67ddf701762-trusted-ca-bundle\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.530339 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.530119 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qcdps\" (UniqueName: \"kubernetes.io/projected/7deee5a3-e270-4155-bbcc-f67ddf701762-kube-api-access-qcdps\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:28.990937 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.990898 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" event={"ID":"42e908ab-7f27-4858-a5ea-f55520e01d47","Type":"ContainerStarted","Data":"3635b38582a1f9dd04dc50fcc6366498e317dd0394665445f2c220dbef3d9122"} Jul 08 16:04:28.991455 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.991072 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:28.992368 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.992344 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8489fb5596-hgsd7" Jul 08 16:04:28.992483 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.992386 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8489fb5596-hgsd7" event={"ID":"7deee5a3-e270-4155-bbcc-f67ddf701762","Type":"ContainerDied","Data":"8a898bcc3ae3b2014196c619f4a0e977bb101d1c17a4d6f2b30dab1d75cf560d"} Jul 08 16:04:28.992483 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:28.992429 2558 scope.go:117] "RemoveContainer" containerID="e786a18d5e280248d548b6f9415225fa5d80557f9f970340858ad06ef886e4cc" Jul 08 16:04:29.009648 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:29.009603 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" podStartSLOduration=2.016178447 podStartE2EDuration="7.009585681s" totalImagesPullingTime="4.993407234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:29.007368479 +0000 UTC m=+521.285464339" watchObservedRunningTime="2026-07-08 16:04:29.009585681 +0000 UTC m=+521.287681589" Jul 08 16:04:29.022443 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:29.022413 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 16:04:29.028362 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:29.028338 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8489fb5596-hgsd7"] Jul 08 16:04:30.328614 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:30.328580 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7deee5a3-e270-4155-bbcc-f67ddf701762" path="/var/lib/kubelet/pods/7deee5a3-e270-4155-bbcc-f67ddf701762/volumes" Jul 08 16:04:35.030134 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.030104 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-lg6f9" Jul 08 16:04:35.413391 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.413320 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:35.598206 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.598174 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:35.628145 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.628104 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smvqd"] Jul 08 16:04:35.628517 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.628505 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7deee5a3-e270-4155-bbcc-f67ddf701762" containerName="console" Jul 08 16:04:35.628561 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.628519 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7deee5a3-e270-4155-bbcc-f67ddf701762" containerName="console" Jul 08 16:04:35.628596 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.628585 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7deee5a3-e270-4155-bbcc-f67ddf701762" containerName="console" Jul 08 16:04:35.633024 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.633003 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:35.640448 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.640426 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ql768\"" Jul 08 16:04:35.642888 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.642865 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smvqd"] Jul 08 16:04:35.797048 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.796932 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x5j6\" (UniqueName: \"kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6\") pod \"authorino-5d4b67c446-smvqd\" (UID: \"ec458863-4434-41d4-8670-9f5238fbcec1\") " pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:35.875311 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.875279 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smvqd"] Jul 08 16:04:35.875583 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:35.875563 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-9x5j6], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-smvqd" podUID="ec458863-4434-41d4-8670-9f5238fbcec1" Jul 08 16:04:35.898126 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.898067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x5j6\" (UniqueName: \"kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6\") pod \"authorino-5d4b67c446-smvqd\" (UID: \"ec458863-4434-41d4-8670-9f5238fbcec1\") " pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:35.909680 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.909648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x5j6\" (UniqueName: \"kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6\") pod \"authorino-5d4b67c446-smvqd\" (UID: \"ec458863-4434-41d4-8670-9f5238fbcec1\") " pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:35.912991 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.912968 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7545b995f9-x79pt"] Jul 08 16:04:35.916435 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.916419 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:35.931386 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.931362 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7545b995f9-x79pt"] Jul 08 16:04:35.992192 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:35.992160 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7545b995f9-x79pt"] Jul 08 16:04:35.992471 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:35.992450 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2z92l], unattached volumes=[], failed to process volumes=[kube-api-access-2z92l]: context canceled" pod="kuadrant-system/authorino-7545b995f9-x79pt" podUID="04de4f6b-a761-43ea-b515-218248879b3d" Jul 08 16:04:36.031231 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.031201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:36.031649 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.031201 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:36.038273 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.038246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:36.041778 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.041759 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:36.100183 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.100063 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z92l\" (UniqueName: \"kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l\") pod \"authorino-7545b995f9-x79pt\" (UID: \"04de4f6b-a761-43ea-b515-218248879b3d\") " pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:36.201319 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.201271 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x5j6\" (UniqueName: \"kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6\") pod \"ec458863-4434-41d4-8670-9f5238fbcec1\" (UID: \"ec458863-4434-41d4-8670-9f5238fbcec1\") " Jul 08 16:04:36.201488 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.201444 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z92l\" (UniqueName: \"kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l\") pod \"authorino-7545b995f9-x79pt\" (UID: \"04de4f6b-a761-43ea-b515-218248879b3d\") " pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:36.203376 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.203343 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6" (OuterVolumeSpecName: "kube-api-access-9x5j6") pod "ec458863-4434-41d4-8670-9f5238fbcec1" (UID: "ec458863-4434-41d4-8670-9f5238fbcec1"). InnerVolumeSpecName "kube-api-access-9x5j6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:36.211350 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.211325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z92l\" (UniqueName: \"kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l\") pod \"authorino-7545b995f9-x79pt\" (UID: \"04de4f6b-a761-43ea-b515-218248879b3d\") " pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:36.302029 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.301997 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x5j6\" (UniqueName: \"kubernetes.io/projected/ec458863-4434-41d4-8670-9f5238fbcec1-kube-api-access-9x5j6\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:36.402423 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.402386 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z92l\" (UniqueName: \"kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l\") pod \"04de4f6b-a761-43ea-b515-218248879b3d\" (UID: \"04de4f6b-a761-43ea-b515-218248879b3d\") " Jul 08 16:04:36.404543 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.404515 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l" (OuterVolumeSpecName: "kube-api-access-2z92l") pod "04de4f6b-a761-43ea-b515-218248879b3d" (UID: "04de4f6b-a761-43ea-b515-218248879b3d"). InnerVolumeSpecName "kube-api-access-2z92l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:36.503034 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:36.503000 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z92l\" (UniqueName: \"kubernetes.io/projected/04de4f6b-a761-43ea-b515-218248879b3d-kube-api-access-2z92l\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:37.037533 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.037497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7545b995f9-x79pt" Jul 08 16:04:37.038022 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.037497 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-smvqd" Jul 08 16:04:37.073561 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.073531 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smvqd"] Jul 08 16:04:37.077455 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.077424 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-smvqd"] Jul 08 16:04:37.116848 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.116809 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7545b995f9-x79pt"] Jul 08 16:04:37.126246 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:37.126209 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7545b995f9-x79pt"] Jul 08 16:04:38.341156 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:38.341126 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04de4f6b-a761-43ea-b515-218248879b3d" path="/var/lib/kubelet/pods/04de4f6b-a761-43ea-b515-218248879b3d/volumes" Jul 08 16:04:38.341535 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:38.341364 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec458863-4434-41d4-8670-9f5238fbcec1" path="/var/lib/kubelet/pods/ec458863-4434-41d4-8670-9f5238fbcec1/volumes" Jul 08 16:04:42.030489 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.030448 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.052027 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.051998 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:42.054633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.054607 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.057978 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.057962 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 16:04:42.058124 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.058021 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 16:04:42.058295 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.058281 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-ktcj2\"" Jul 08 16:04:42.071194 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.071165 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:42.125512 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.125484 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.153432 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.153404 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.153577 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.153444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.195334 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.195298 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.254280 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.254250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.254484 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.254300 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.254484 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:42.254427 2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 08 16:04:42.254606 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:42.254501 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert podName:22bb4f3c-d4ce-4da5-8ca6-32c044500bf6 nodeName:}" failed. No retries permitted until 2026-07-08 16:04:42.754480916 +0000 UTC m=+535.032576750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert") pod "maas-controller-844b7c78d4-pwktq" (UID: "22bb4f3c-d4ce-4da5-8ca6-32c044500bf6") : secret "maas-controller-webhook-cert" not found Jul 08 16:04:42.263659 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.263629 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.410323 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.410288 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:42.758509 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.758419 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.760801 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.760778 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") pod \"maas-controller-844b7c78d4-pwktq\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:42.965688 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:42.965656 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:43.108485 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:43.108459 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:43.111111 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:04:43.111063 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22bb4f3c_d4ce_4da5_8ca6_32c044500bf6.slice/crio-8f043b06f83b55943b15ac077957b48a50cf82a2cd67a26f030a34c9140fb587 WatchSource:0}: Error finding container 8f043b06f83b55943b15ac077957b48a50cf82a2cd67a26f030a34c9140fb587: Status 404 returned error can't find the container with id 8f043b06f83b55943b15ac077957b48a50cf82a2cd67a26f030a34c9140fb587 Jul 08 16:04:44.079826 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:44.079789 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b7c78d4-pwktq" event={"ID":"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6","Type":"ContainerStarted","Data":"8f043b06f83b55943b15ac077957b48a50cf82a2cd67a26f030a34c9140fb587"} Jul 08 16:04:45.306150 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:45.306063 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:45.404994 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:45.404958 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:46.093448 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:46.093413 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b7c78d4-pwktq" event={"ID":"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6","Type":"ContainerStarted","Data":"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede"} Jul 08 16:04:46.093634 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:46.093561 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:46.115893 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:46.115837 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-844b7c78d4-pwktq" podStartSLOduration=2.175038194 podStartE2EDuration="4.115819755s" totalImagesPullingTime="1.940781561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:04:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:04:46.11350757 +0000 UTC m=+538.391603429" watchObservedRunningTime="2026-07-08 16:04:46.115819755 +0000 UTC m=+538.393915611" Jul 08 16:04:56.533193 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.533155 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:56.533761 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.533375 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-844b7c78d4-pwktq" podUID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" containerName="manager" containerID="cri-o://1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede" gracePeriod=30 Jul 08 16:04:56.541185 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.541162 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:56.785414 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.785358 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:56.891295 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.891241 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") pod \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " Jul 08 16:04:56.891506 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.891315 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx\") pod \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\" (UID: \"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6\") " Jul 08 16:04:56.893494 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.893458 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx" (OuterVolumeSpecName: "kube-api-access-zd8cx") pod "22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" (UID: "22bb4f3c-d4ce-4da5-8ca6-32c044500bf6"). InnerVolumeSpecName "kube-api-access-zd8cx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 16:04:56.893494 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.893484 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" (UID: "22bb4f3c-d4ce-4da5-8ca6-32c044500bf6"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 16:04:56.992213 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.992177 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-webhook-cert\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:56.992213 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:56.992214 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zd8cx\" (UniqueName: \"kubernetes.io/projected/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6-kube-api-access-zd8cx\") on node \"ip-10-0-128-249.ec2.internal\" DevicePath \"\"" Jul 08 16:04:57.164690 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.164657 2558 generic.go:356] "Generic (PLEG): container finished" podID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" containerID="1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede" exitCode=0 Jul 08 16:04:57.164833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.164702 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-844b7c78d4-pwktq" Jul 08 16:04:57.164833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.164703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b7c78d4-pwktq" event={"ID":"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6","Type":"ContainerDied","Data":"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede"} Jul 08 16:04:57.164833 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.164822 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-844b7c78d4-pwktq" event={"ID":"22bb4f3c-d4ce-4da5-8ca6-32c044500bf6","Type":"ContainerDied","Data":"8f043b06f83b55943b15ac077957b48a50cf82a2cd67a26f030a34c9140fb587"} Jul 08 16:04:57.164983 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.164848 2558 scope.go:117] "RemoveContainer" containerID="1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede" Jul 08 16:04:57.174340 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.174320 2558 scope.go:117] "RemoveContainer" containerID="1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede" Jul 08 16:04:57.174602 ip-10-0-128-249 kubenswrapper[2558]: E0708 16:04:57.174585 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede\": container with ID starting with 1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede not found: ID does not exist" containerID="1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede" Jul 08 16:04:57.174645 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.174612 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede"} err="failed to get container status \"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede\": rpc error: code = NotFound desc = could not find container \"1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede\": container with ID starting with 1472f86e353c12bf2b6b476294f87c9041c1979cfb315fe8301b6e5bbe84cede not found: ID does not exist" Jul 08 16:04:57.187655 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.187622 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:57.189947 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:57.189922 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-844b7c78d4-pwktq"] Jul 08 16:04:58.329261 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:58.329224 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" path="/var/lib/kubelet/pods/22bb4f3c-d4ce-4da5-8ca6-32c044500bf6/volumes" Jul 08 16:04:59.571760 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:59.571728 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:04:59.670526 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:04:59.670486 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:16.946318 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:16.946285 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:17.462681 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.462644 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-69666d4784-c48n7"] Jul 08 16:05:17.463120 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.463096 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" containerName="manager" Jul 08 16:05:17.463120 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.463122 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" containerName="manager" Jul 08 16:05:17.463235 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.463194 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="22bb4f3c-d4ce-4da5-8ca6-32c044500bf6" containerName="manager" Jul 08 16:05:17.465225 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.465209 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.468021 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.467993 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 08 16:05:17.468021 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.468018 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mswmc\"" Jul 08 16:05:17.479679 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.479653 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69666d4784-c48n7"] Jul 08 16:05:17.593205 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.593175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6pgb\" (UniqueName: \"kubernetes.io/projected/fe26f308-ad98-46d4-8750-29a6246d2a3b-kube-api-access-q6pgb\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.593393 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.593252 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe26f308-ad98-46d4-8750-29a6246d2a3b-openshift-service-ca\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.593393 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.593306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe26f308-ad98-46d4-8750-29a6246d2a3b-maas-api-tls\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.694673 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.694630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe26f308-ad98-46d4-8750-29a6246d2a3b-openshift-service-ca\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.694861 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.694698 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe26f308-ad98-46d4-8750-29a6246d2a3b-maas-api-tls\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.694861 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.694727 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6pgb\" (UniqueName: \"kubernetes.io/projected/fe26f308-ad98-46d4-8750-29a6246d2a3b-kube-api-access-q6pgb\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.695321 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.695300 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe26f308-ad98-46d4-8750-29a6246d2a3b-openshift-service-ca\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.697323 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.697299 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe26f308-ad98-46d4-8750-29a6246d2a3b-maas-api-tls\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.705306 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.705280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6pgb\" (UniqueName: \"kubernetes.io/projected/fe26f308-ad98-46d4-8750-29a6246d2a3b-kube-api-access-q6pgb\") pod \"maas-api-69666d4784-c48n7\" (UID: \"fe26f308-ad98-46d4-8750-29a6246d2a3b\") " pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.775905 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.775811 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:17.941836 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:17.941814 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-69666d4784-c48n7"] Jul 08 16:05:17.943391 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:05:17.943365 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe26f308_ad98_46d4_8750_29a6246d2a3b.slice/crio-376836a4bf2ae775f097ff71596ac2aac0f2df04f9f8b674c941a73faa439021 WatchSource:0}: Error finding container 376836a4bf2ae775f097ff71596ac2aac0f2df04f9f8b674c941a73faa439021: Status 404 returned error can't find the container with id 376836a4bf2ae775f097ff71596ac2aac0f2df04f9f8b674c941a73faa439021 Jul 08 16:05:18.283257 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:18.283220 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" event={"ID":"fe26f308-ad98-46d4-8750-29a6246d2a3b","Type":"ContainerStarted","Data":"376836a4bf2ae775f097ff71596ac2aac0f2df04f9f8b674c941a73faa439021"} Jul 08 16:05:18.640246 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:18.640211 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:20.296552 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:20.296521 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" event={"ID":"fe26f308-ad98-46d4-8750-29a6246d2a3b","Type":"ContainerStarted","Data":"541e546ddee0df02df13a6afd73e4dea5d538c3bf396b3db23d98c8bd98215ab"} Jul 08 16:05:20.296970 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:20.296634 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:20.313794 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:20.313741 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" podStartSLOduration=1.411601995 podStartE2EDuration="3.313722646s" totalImagesPullingTime="1.902120651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:20.312977924 +0000 UTC m=+572.591073782" watchObservedRunningTime="2026-07-08 16:05:20.313722646 +0000 UTC m=+572.591818505" Jul 08 16:05:26.307941 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:26.307915 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-69666d4784-c48n7" Jul 08 16:05:28.226615 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:28.226582 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:28.352386 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:28.352354 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:32.600248 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:32.600215 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:32.716750 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:32.716708 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:34.217865 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:34.217815 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:45.172325 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:45.172292 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:48.241591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:48.241561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 16:05:48.242338 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:48.242318 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zzgqm_541930f0-fa02-4c6e-b347-7c7f17f729cc/ovn-acl-logging/0.log" Jul 08 16:05:51.778269 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:51.778231 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ck4tk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 16:05:51.778706 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:51.778287 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podUID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 16:05:53.479373 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.479278 2558 generic.go:356] "Generic (PLEG): container finished" podID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerID="6299d786a2751ecd1a9ad77353f04284bb547109e9eb66e8a85c87c27b2cafcd" exitCode=0 Jul 08 16:05:53.479373 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.479355 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" event={"ID":"dd474187-f44c-47dc-b917-2ee3fa25ba5e","Type":"ContainerDied","Data":"6299d786a2751ecd1a9ad77353f04284bb547109e9eb66e8a85c87c27b2cafcd"} Jul 08 16:05:53.479809 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.479744 2558 scope.go:117] "RemoveContainer" containerID="6299d786a2751ecd1a9ad77353f04284bb547109e9eb66e8a85c87c27b2cafcd" Jul 08 16:05:53.480816 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.480784 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:05:53.480939 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.480875 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:05:53.480939 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.480924 2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 08 16:05:53.741432 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.741350 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49"] Jul 08 16:05:53.743891 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.743872 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.747501 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.747471 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 08 16:05:53.747614 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.747561 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wwcf6\"" Jul 08 16:05:53.747614 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.747570 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 16:05:53.747794 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.747711 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 16:05:53.761271 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.761243 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49"] Jul 08 16:05:53.765716 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.765693 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:05:53.815747 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815718 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.815932 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815781 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.815932 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd05891-7885-4686-ba80-d5ee78979ad4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.815932 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.815932 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxhgq\" (UniqueName: \"kubernetes.io/projected/3dd05891-7885-4686-ba80-d5ee78979ad4-kube-api-access-zxhgq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.816101 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.815954 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.916873 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.916836 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.916886 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxhgq\" (UniqueName: \"kubernetes.io/projected/3dd05891-7885-4686-ba80-d5ee78979ad4-kube-api-access-zxhgq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.916914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.916948 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.917005 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.917025 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd05891-7885-4686-ba80-d5ee78979ad4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917377 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.917353 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917377 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.917368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.917456 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.917445 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.919268 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.919239 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3dd05891-7885-4686-ba80-d5ee78979ad4-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.919428 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.919413 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3dd05891-7885-4686-ba80-d5ee78979ad4-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:53.925927 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:53.925907 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxhgq\" (UniqueName: \"kubernetes.io/projected/3dd05891-7885-4686-ba80-d5ee78979ad4-kube-api-access-zxhgq\") pod \"e2e-distinct-simulated-kserve-59975d69f9-wwz49\" (UID: \"3dd05891-7885-4686-ba80-d5ee78979ad4\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:54.055630 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:54.055538 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:05:54.197758 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:54.197732 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49"] Jul 08 16:05:54.199975 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:05:54.199948 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dd05891_7885_4686_ba80_d5ee78979ad4.slice/crio-45fcbad865d4e4802b8a8743d4c77a3a9bb7e0fea9ef55cabc2ccedb58381e96 WatchSource:0}: Error finding container 45fcbad865d4e4802b8a8743d4c77a3a9bb7e0fea9ef55cabc2ccedb58381e96: Status 404 returned error can't find the container with id 45fcbad865d4e4802b8a8743d4c77a3a9bb7e0fea9ef55cabc2ccedb58381e96 Jul 08 16:05:54.201328 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:54.201311 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 16:05:54.486438 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:54.486403 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" event={"ID":"3dd05891-7885-4686-ba80-d5ee78979ad4","Type":"ContainerStarted","Data":"45fcbad865d4e4802b8a8743d4c77a3a9bb7e0fea9ef55cabc2ccedb58381e96"} Jul 08 16:05:54.488582 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:54.488555 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" event={"ID":"dd474187-f44c-47dc-b917-2ee3fa25ba5e","Type":"ContainerStarted","Data":"0da8db14c54d46aa7f08478c4ed94d61ca624d7ab897da51e5fedc226bc0f055"} Jul 08 16:05:55.401652 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:55.401567 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:05:55.402308 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:55.401938 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ck4tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 08 16:05:55.402308 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:55.401989 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podUID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 08 16:05:56.382720 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:56.382672 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ck4tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 08 16:05:56.383265 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:56.382746 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podUID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 08 16:05:56.516168 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:56.516135 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" event={"ID":"3dd05891-7885-4686-ba80-d5ee78979ad4","Type":"ContainerStarted","Data":"e64a36668b2b110762a657fb2054f09b30a912f1ac015d891b6e949f50b2a7e0"} Jul 08 16:05:56.536383 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:56.536330 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" podStartSLOduration=2.036461393 podStartE2EDuration="3.536311669s" totalImagesPullingTime="1.499850276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:05:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:05:56.534296512 +0000 UTC m=+608.812392407" watchObservedRunningTime="2026-07-08 16:05:56.536311669 +0000 UTC m=+608.814407526" Jul 08 16:05:57.383113 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:57.383052 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ck4tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 08 16:05:57.383630 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:57.383152 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podUID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 08 16:05:58.383399 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:58.383350 2558 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-ck4tk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body= Jul 08 16:05:58.383915 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:58.383426 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" podUID="dd474187-f44c-47dc-b917-2ee3fa25ba5e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" Jul 08 16:05:59.386167 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:59.386139 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:05:59.386552 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:59.386484 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:05:59.387172 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:05:59.387152 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-ck4tk" Jul 08 16:06:01.847654 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.847618 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d"] Jul 08 16:06:01.850927 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.850906 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.854260 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.854242 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 08 16:06:01.871223 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.871179 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d"] Jul 08 16:06:01.887520 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887486 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.887687 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887591 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg9c8\" (UniqueName: \"kubernetes.io/projected/9171910e-8385-42e6-98e7-29d615c649fd-kube-api-access-mg9c8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.887687 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887645 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.887765 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.887765 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887751 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.887828 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.887778 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9171910e-8385-42e6-98e7-29d615c649fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.924842 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.924805 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:01.988669 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988634 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.988822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.988822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.988822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988757 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9171910e-8385-42e6-98e7-29d615c649fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.988822 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988797 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.989038 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.988852 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg9c8\" (UniqueName: \"kubernetes.io/projected/9171910e-8385-42e6-98e7-29d615c649fd-kube-api-access-mg9c8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.989127 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.989071 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.989247 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.989226 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.989315 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.989275 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.990825 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.990802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9171910e-8385-42e6-98e7-29d615c649fd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.991193 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.991175 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9171910e-8385-42e6-98e7-29d615c649fd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:01.999340 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:01.999312 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg9c8\" (UniqueName: \"kubernetes.io/projected/9171910e-8385-42e6-98e7-29d615c649fd-kube-api-access-mg9c8\") pod \"e2e-trlp-test-simulated-kserve-598466548d-ck52d\" (UID: \"9171910e-8385-42e6-98e7-29d615c649fd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:02.166614 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:02.166572 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:02.311459 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:02.311429 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d"] Jul 08 16:06:02.313336 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:06:02.313306 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9171910e_8385_42e6_98e7_29d615c649fd.slice/crio-639c3aa1efa48c76f3f9fb12731b98644f4b9d4c8bebfe741c53a9cacfb55552 WatchSource:0}: Error finding container 639c3aa1efa48c76f3f9fb12731b98644f4b9d4c8bebfe741c53a9cacfb55552: Status 404 returned error can't find the container with id 639c3aa1efa48c76f3f9fb12731b98644f4b9d4c8bebfe741c53a9cacfb55552 Jul 08 16:06:02.551793 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:02.551710 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" event={"ID":"9171910e-8385-42e6-98e7-29d615c649fd","Type":"ContainerStarted","Data":"639c3aa1efa48c76f3f9fb12731b98644f4b9d4c8bebfe741c53a9cacfb55552"} Jul 08 16:06:03.559038 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:03.559005 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" event={"ID":"9171910e-8385-42e6-98e7-29d615c649fd","Type":"ContainerStarted","Data":"e3c54f62798bda0bf88cb6c38f3ad105732b0a7338f124dff8f372ea660e9828"} Jul 08 16:06:03.581194 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:03.581142 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" podStartSLOduration=2.270264606 podStartE2EDuration="2.5811249s" totalImagesPullingTime="310.860294ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:03.577936397 +0000 UTC m=+615.856032275" watchObservedRunningTime="2026-07-08 16:06:03.5811249 +0000 UTC m=+615.859220756" Jul 08 16:06:04.055927 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:04.055888 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:06:04.056138 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:04.055950 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:06:04.068580 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:04.068549 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:06:04.576421 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:04.576383 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-wwz49" Jul 08 16:06:12.166905 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:12.166818 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:12.166905 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:12.166895 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:12.180642 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:12.180614 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:12.621213 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:12.621189 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-ck52d" Jul 08 16:06:29.574718 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:29.574643 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:44.186770 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:44.186733 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:45.763893 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:45.763857 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:06:48.133934 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.133904 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp"] Jul 08 16:06:48.137039 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.137012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.139941 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.139922 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 08 16:06:48.150598 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.150577 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp"] Jul 08 16:06:48.173206 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.173178 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:48.220949 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.220916 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75374abb-d481-49a0-bfc3-3adf12d0c41d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.221130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.220962 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.221130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.221001 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khn2p\" (UniqueName: \"kubernetes.io/projected/75374abb-d481-49a0-bfc3-3adf12d0c41d-kube-api-access-khn2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.221130 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.221102 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.221246 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.221154 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.221246 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.221180 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322433 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322395 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75374abb-d481-49a0-bfc3-3adf12d0c41d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322488 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khn2p\" (UniqueName: \"kubernetes.io/projected/75374abb-d481-49a0-bfc3-3adf12d0c41d-kube-api-access-khn2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322521 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322589 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.322633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.322630 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.323077 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.323049 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.323279 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.323256 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.323348 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.323280 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.325775 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.325740 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75374abb-d481-49a0-bfc3-3adf12d0c41d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.325908 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.325862 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75374abb-d481-49a0-bfc3-3adf12d0c41d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.331570 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.331543 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khn2p\" (UniqueName: \"kubernetes.io/projected/75374abb-d481-49a0-bfc3-3adf12d0c41d-kube-api-access-khn2p\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp\" (UID: \"75374abb-d481-49a0-bfc3-3adf12d0c41d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.449983 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.449895 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:48.589477 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.589449 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp"] Jul 08 16:06:48.590305 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:06:48.590282 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75374abb_d481_49a0_bfc3_3adf12d0c41d.slice/crio-6794d79249a8c4c7029897b1924c56df11f444712329298c13f4eb6622e98db8 WatchSource:0}: Error finding container 6794d79249a8c4c7029897b1924c56df11f444712329298c13f4eb6622e98db8: Status 404 returned error can't find the container with id 6794d79249a8c4c7029897b1924c56df11f444712329298c13f4eb6622e98db8 Jul 08 16:06:48.819702 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:48.819616 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" event={"ID":"75374abb-d481-49a0-bfc3-3adf12d0c41d","Type":"ContainerStarted","Data":"6794d79249a8c4c7029897b1924c56df11f444712329298c13f4eb6622e98db8"} Jul 08 16:06:49.017416 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:49.017364 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:06:49.827816 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:49.827779 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" event={"ID":"75374abb-d481-49a0-bfc3-3adf12d0c41d","Type":"ContainerStarted","Data":"b4897dc5d8fac3b9d975ac96c85a979a1bb558d59aecb597b9bda26006280ac0"} Jul 08 16:06:49.846995 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:49.846939 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" podStartSLOduration=1.522236023 podStartE2EDuration="1.846920086s" totalImagesPullingTime="324.684063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 16:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:06:49.844798381 +0000 UTC m=+662.122894251" watchObservedRunningTime="2026-07-08 16:06:49.846920086 +0000 UTC m=+662.125015962" Jul 08 16:06:50.646601 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:50.646565 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fbbp6"] Jul 08 16:06:58.450483 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:58.450440 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:58.450942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:58.450524 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:58.463307 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:58.463285 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:06:58.892074 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:06:58.892039 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp" Jul 08 16:07:19.927990 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:19.927947 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:43.273787 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:43.273749 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:46.411229 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:46.411192 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:46.498072 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:46.498021 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:47.629468 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:47.629427 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:07:47.727922 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:07:47.727884 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:21.645645 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:21.645611 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:21.717293 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:21.717260 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:30.603065 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:30.603037 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lczld_97f2fe57-a3f2-4021-a5aa-e095c14f4112/manager/0.log" Jul 08 16:08:30.732953 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:30.732922 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-crdq5_ee4b404e-e245-4793-93ca-1840b0bd4b19/manager/0.log" Jul 08 16:08:31.114147 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:31.114116 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x8gwf_18c98917-329a-4095-a65f-67bd77822d92/server/0.log" Jul 08 16:08:31.241262 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:31.241214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bbj9x_c90e0a30-67af-4274-b56c-5f34d4bfab5d/manager/0.log" Jul 08 16:08:31.493186 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:31.493109 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588bc5dd4b-nzv55_ee5610cf-05bd-461f-a667-71702971b95f/copy-manifests/0.log" Jul 08 16:08:31.501023 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:31.500991 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588bc5dd4b-nzv55_ee5610cf-05bd-461f-a667-71702971b95f/manager/0.log" Jul 08 16:08:32.472912 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.472881 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/util/0.log" Jul 08 16:08:32.479551 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.479526 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/pull/0.log" Jul 08 16:08:32.485250 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.485232 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/extract/0.log" Jul 08 16:08:32.616212 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.616186 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/util/0.log" Jul 08 16:08:32.623522 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.623499 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/pull/0.log" Jul 08 16:08:32.630740 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.630720 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/extract/0.log" Jul 08 16:08:32.750853 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.750773 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/pull/0.log" Jul 08 16:08:32.758975 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.758953 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/extract/0.log" Jul 08 16:08:32.766444 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.766418 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/util/0.log" Jul 08 16:08:32.885623 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.885602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/util/0.log" Jul 08 16:08:32.892055 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.892027 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/pull/0.log" Jul 08 16:08:32.897957 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:32.897942 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/extract/0.log" Jul 08 16:08:33.149253 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.149224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-stgnf_bed1e1bd-bb5a-4cd9-8556-25ad94b26059/manager/0.log" Jul 08 16:08:33.280049 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.280025 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-trjl9_901187b0-450d-4be1-a483-bf7a94041f1b/manager/0.log" Jul 08 16:08:33.397782 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.397759 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d7btg_ff8f5d1c-961e-4219-a4fb-093dedc12a04/kuadrant-console-plugin/0.log" Jul 08 16:08:33.541669 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.541593 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m4s5v_24ed2509-2947-40c5-8672-ad55266b04ad/registry-server/0.log" Jul 08 16:08:33.811211 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.811124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fbbp6_c498ec80-adcc-4622-bd59-ef8ab89dace6/limitador/0.log" Jul 08 16:08:33.940589 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:33.940565 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-89msc_d19bb065-aeae-46d4-b545-862ff72cc1e5/manager/0.log" Jul 08 16:08:34.559262 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:34.559227 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4b79bd44-srrnf_13afbb97-4b5d-4235-8b7d-6e2eb9907052/kube-auth-proxy/0.log" Jul 08 16:08:34.799736 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:34.799708 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/1.log" Jul 08 16:08:35.431606 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:35.431581 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-wwz49_3dd05891-7885-4686-ba80-d5ee78979ad4/main/0.log" Jul 08 16:08:35.554272 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:35.554237 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-ck52d_9171910e-8385-42e6-98e7-29d615c649fd/main/0.log" Jul 08 16:08:35.932424 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:35.932399 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-56ksp_75374abb-d481-49a0-bfc3-3adf12d0c41d/main/0.log" Jul 08 16:08:40.580252 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:40.580224 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:40.729902 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:40.729859 2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" limit=1024 Jul 08 16:08:44.056260 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:44.056224 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-482z8_c2c7f250-8d3c-41c8-95fa-fae62dbd4d51/global-pull-secret-syncer/0.log" Jul 08 16:08:44.186252 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:44.186228 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hkxpv_0edba22a-f9a3-4862-881b-861997e41d7a/konnectivity-agent/0.log" Jul 08 16:08:44.262238 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:44.262208 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-249.ec2.internal_c8b1070cf4e29bff8acdce8685ad7f5b/haproxy/0.log" Jul 08 16:08:49.057919 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.057889 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/extract/0.log" Jul 08 16:08:49.081706 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.081665 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/util/0.log" Jul 08 16:08:49.107429 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.107406 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rf8d6_81a8bb70-17a5-4823-8191-7b9d7809f826/pull/0.log" Jul 08 16:08:49.135089 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.135068 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/extract/0.log" Jul 08 16:08:49.157589 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.157561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/util/0.log" Jul 08 16:08:49.181599 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.181577 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0dsln5_dbd18fc9-b0c8-49a8-805d-0c75c08a71ef/pull/0.log" Jul 08 16:08:49.210111 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.210066 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/extract/0.log" Jul 08 16:08:49.234670 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.234643 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/util/0.log" Jul 08 16:08:49.256555 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.256532 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73h2xw4_b879b4db-3fbd-4b1e-8d9b-f808e6b70a4a/pull/0.log" Jul 08 16:08:49.283549 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.283527 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/extract/0.log" Jul 08 16:08:49.307992 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.307917 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/util/0.log" Jul 08 16:08:49.336654 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.336627 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1c6pd9_54b421ff-c64b-41dd-8e49-e45de3853701/pull/0.log" Jul 08 16:08:49.427140 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.427113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-stgnf_bed1e1bd-bb5a-4cd9-8556-25ad94b26059/manager/0.log" Jul 08 16:08:49.454068 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.454041 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-trjl9_901187b0-450d-4be1-a483-bf7a94041f1b/manager/0.log" Jul 08 16:08:49.480523 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.480500 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d7btg_ff8f5d1c-961e-4219-a4fb-093dedc12a04/kuadrant-console-plugin/0.log" Jul 08 16:08:49.511384 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.511340 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-m4s5v_24ed2509-2947-40c5-8672-ad55266b04ad/registry-server/0.log" Jul 08 16:08:49.580398 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.580310 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fbbp6_c498ec80-adcc-4622-bd59-ef8ab89dace6/limitador/0.log" Jul 08 16:08:49.606167 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:49.606140 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-89msc_d19bb065-aeae-46d4-b545-862ff72cc1e5/manager/0.log" Jul 08 16:08:51.256770 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.256742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/alertmanager/0.log" Jul 08 16:08:51.287174 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.287139 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/config-reloader/0.log" Jul 08 16:08:51.313465 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.313443 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/kube-rbac-proxy-web/0.log" Jul 08 16:08:51.340629 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.340606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/kube-rbac-proxy/0.log" Jul 08 16:08:51.365424 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.365395 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/kube-rbac-proxy-metric/0.log" Jul 08 16:08:51.396586 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.396549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/prom-label-proxy/0.log" Jul 08 16:08:51.418779 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.418750 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_860a9cf8-7b2d-4f13-b940-b037d560203d/init-config-reloader/0.log" Jul 08 16:08:51.487835 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.487810 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z5djw_d9a1e6b6-1f53-4252-99f0-7f9afefce312/kube-state-metrics/0.log" Jul 08 16:08:51.512361 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.512282 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z5djw_d9a1e6b6-1f53-4252-99f0-7f9afefce312/kube-rbac-proxy-main/0.log" Jul 08 16:08:51.537271 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.537241 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-z5djw_d9a1e6b6-1f53-4252-99f0-7f9afefce312/kube-rbac-proxy-self/0.log" Jul 08 16:08:51.566625 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.566602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-75dfd6d966-xttqf_e0aa8a7d-8e5c-46ef-9982-5fdd516ffb73/metrics-server/0.log" Jul 08 16:08:51.628868 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.628839 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwpn_a5d42a09-65da-4767-be92-2f95f8e36820/node-exporter/0.log" Jul 08 16:08:51.650574 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.650549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwpn_a5d42a09-65da-4767-be92-2f95f8e36820/kube-rbac-proxy/0.log" Jul 08 16:08:51.675482 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.675459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5wwpn_a5d42a09-65da-4767-be92-2f95f8e36820/init-textfile/0.log" Jul 08 16:08:51.884648 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.884623 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-f8699_b38a0028-66d2-4906-a0c2-8efa6e7c6dc9/kube-rbac-proxy-main/0.log" Jul 08 16:08:51.906072 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.906046 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-f8699_b38a0028-66d2-4906-a0c2-8efa6e7c6dc9/kube-rbac-proxy-self/0.log" Jul 08 16:08:51.928304 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:51.928276 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-f8699_b38a0028-66d2-4906-a0c2-8efa6e7c6dc9/openshift-state-metrics/0.log" Jul 08 16:08:52.185292 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.185208 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9d489_da7788f1-1248-4ff1-b107-6ba0997d2982/prometheus-operator/0.log" Jul 08 16:08:52.209177 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.209149 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-9d489_da7788f1-1248-4ff1-b107-6ba0997d2982/kube-rbac-proxy/0.log" Jul 08 16:08:52.241481 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.241449 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-vrx22_c6b7b55b-240b-4cbc-b4f3-157633d5d031/prometheus-operator-admission-webhook/0.log" Jul 08 16:08:52.275211 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.275186 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dbbccdd68-v9875_6f740551-ac8f-40be-9895-2124d08d55b0/telemeter-client/0.log" Jul 08 16:08:52.298343 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.298315 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dbbccdd68-v9875_6f740551-ac8f-40be-9895-2124d08d55b0/reload/0.log" Jul 08 16:08:52.321308 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:52.321288 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dbbccdd68-v9875_6f740551-ac8f-40be-9895-2124d08d55b0/kube-rbac-proxy/0.log" Jul 08 16:08:54.732944 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.732913 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55fc65969c-zplwq_bb889c8d-ed66-472e-9cfb-9c766c6c4a17/console/0.log" Jul 08 16:08:54.947602 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.947570 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j"] Jul 08 16:08:54.951375 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.951352 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:54.954341 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.954320 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ns6ww\"/\"openshift-service-ca.crt\"" Jul 08 16:08:54.954476 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.954456 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ns6ww\"/\"kube-root-ca.crt\"" Jul 08 16:08:54.955818 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.955796 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ns6ww\"/\"default-dockercfg-6rhhf\"" Jul 08 16:08:54.959716 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:54.959689 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j"] Jul 08 16:08:55.016718 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.016638 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqk8\" (UniqueName: \"kubernetes.io/projected/77f75b92-98c4-43df-91df-496520d84db7-kube-api-access-dkqk8\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.016718 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.016687 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-proc\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.016902 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.016774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-lib-modules\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.016902 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.016810 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-sys\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.016970 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.016912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-podres\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118474 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118441 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-podres\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118495 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqk8\" (UniqueName: \"kubernetes.io/projected/77f75b92-98c4-43df-91df-496520d84db7-kube-api-access-dkqk8\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118528 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-proc\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118560 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-lib-modules\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-sys\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118621 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-podres\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118663 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118631 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-proc\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118685 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-sys\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.118942 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.118733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/77f75b92-98c4-43df-91df-496520d84db7-lib-modules\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.127881 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.127856 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqk8\" (UniqueName: \"kubernetes.io/projected/77f75b92-98c4-43df-91df-496520d84db7-kube-api-access-dkqk8\") pod \"perf-node-gather-daemonset-v5l5j\" (UID: \"77f75b92-98c4-43df-91df-496520d84db7\") " pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.262342 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.262306 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.402163 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.402073 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j"] Jul 08 16:08:55.404114 ip-10-0-128-249 kubenswrapper[2558]: W0708 16:08:55.404071 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod77f75b92_98c4_43df_91df_496520d84db7.slice/crio-b1e44564de9708b5442b8aa7740f79569ba87df371c79d1bff79616478f1f039 WatchSource:0}: Error finding container b1e44564de9708b5442b8aa7740f79569ba87df371c79d1bff79616478f1f039: Status 404 returned error can't find the container with id b1e44564de9708b5442b8aa7740f79569ba87df371c79d1bff79616478f1f039 Jul 08 16:08:55.545008 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.544925 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" event={"ID":"77f75b92-98c4-43df-91df-496520d84db7","Type":"ContainerStarted","Data":"769a757b4e2a63501412c5cda902b0900c088055e175576785b7cc823d0e88c7"} Jul 08 16:08:55.545008 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.544979 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" event={"ID":"77f75b92-98c4-43df-91df-496520d84db7","Type":"ContainerStarted","Data":"b1e44564de9708b5442b8aa7740f79569ba87df371c79d1bff79616478f1f039"} Jul 08 16:08:55.545229 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.545052 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:08:55.561883 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:55.561838 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" podStartSLOduration=1.5618242260000001 podStartE2EDuration="1.561824226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 16:08:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 16:08:55.561141675 +0000 UTC m=+787.839237558" watchObservedRunningTime="2026-07-08 16:08:55.561824226 +0000 UTC m=+787.839920083" Jul 08 16:08:56.471916 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:56.471887 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdt2s_efef9934-4ae2-4710-856e-ebda733aa46e/dns/0.log" Jul 08 16:08:56.492633 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:56.492600 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pdt2s_efef9934-4ae2-4710-856e-ebda733aa46e/kube-rbac-proxy/0.log" Jul 08 16:08:56.562837 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:56.562813 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-q5qpz_9e20189c-8542-4e7c-af5b-5824d893c40e/dns-node-resolver/0.log" Jul 08 16:08:57.125873 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:57.125849 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9nh2v_9a2d1aec-4121-4172-be69-14b38bf42fcd/node-ca/0.log" Jul 08 16:08:58.098533 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:58.098507 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4b79bd44-srrnf_13afbb97-4b5d-4235-8b7d-6e2eb9907052/kube-auth-proxy/0.log" Jul 08 16:08:58.172460 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:58.172428 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/1.log" Jul 08 16:08:58.172900 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:58.172884 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/0.log" Jul 08 16:08:58.797554 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:58.797524 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pklc7_8b11d0df-d1a6-464b-8547-cf2be847cc3a/serve-healthcheck-canary/0.log" Jul 08 16:08:59.337637 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:59.337606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8lkv_57e1c730-2d02-4410-9816-ede39442e0a4/kube-rbac-proxy/0.log" Jul 08 16:08:59.358765 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:59.358738 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8lkv_57e1c730-2d02-4410-9816-ede39442e0a4/exporter/0.log" Jul 08 16:08:59.396683 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:08:59.396656 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g8lkv_57e1c730-2d02-4410-9816-ede39442e0a4/extractor/0.log" Jul 08 16:09:01.560761 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.560730 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ns6ww/perf-node-gather-daemonset-v5l5j" Jul 08 16:09:01.659600 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.659576 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-lczld_97f2fe57-a3f2-4021-a5aa-e095c14f4112/manager/0.log" Jul 08 16:09:01.690655 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.690632 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-crdq5_ee4b404e-e245-4793-93ca-1840b0bd4b19/manager/0.log" Jul 08 16:09:01.738738 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.738711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-x8gwf_18c98917-329a-4095-a65f-67bd77822d92/server/0.log" Jul 08 16:09:01.786138 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.786113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-bbj9x_c90e0a30-67af-4274-b56c-5f34d4bfab5d/manager/0.log" Jul 08 16:09:01.854147 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.854065 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588bc5dd4b-nzv55_ee5610cf-05bd-461f-a667-71702971b95f/manager/0.log" Jul 08 16:09:01.876613 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:01.876588 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-588bc5dd4b-nzv55_ee5610cf-05bd-461f-a667-71702971b95f/copy-manifests/0.log" Jul 08 16:09:04.955000 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:04.954973 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4b79bd44-srrnf_13afbb97-4b5d-4235-8b7d-6e2eb9907052/kube-auth-proxy/0.log" Jul 08 16:09:04.990512 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:04.990485 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/1.log" Jul 08 16:09:04.991016 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:04.990992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/0.log" Jul 08 16:09:06.098629 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:06.098549 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d4b79bd44-srrnf_13afbb97-4b5d-4235-8b7d-6e2eb9907052/kube-auth-proxy/0.log" Jul 08 16:09:06.148537 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:06.148506 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/1.log" Jul 08 16:09:06.148777 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:06.148761 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-ck4tk_dd474187-f44c-47dc-b917-2ee3fa25ba5e/istio-proxy/0.log" Jul 08 16:09:10.172385 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.172311 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/kube-multus-additional-cni-plugins/0.log" Jul 08 16:09:10.194704 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.194675 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/egress-router-binary-copy/0.log" Jul 08 16:09:10.214583 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.214557 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/cni-plugins/0.log" Jul 08 16:09:10.235672 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.235645 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/bond-cni-plugin/0.log" Jul 08 16:09:10.264731 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.264704 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/routeoverride-cni/0.log" Jul 08 16:09:10.287365 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.287339 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/whereabouts-cni-bincopy/0.log" Jul 08 16:09:10.311660 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.311636 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q2j7f_b2f55dfb-8b69-4985-b0c4-d256eca18e0b/whereabouts-cni/0.log" Jul 08 16:09:10.344591 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.344561 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dg6cg_cc61a4a9-39c8-4b2f-be2a-e40c76f1d100/kube-multus/0.log" Jul 08 16:09:10.414095 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.414064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58zvw_c7198ffb-8622-414a-8462-6537510922d4/network-metrics-daemon/0.log" Jul 08 16:09:10.433348 ip-10-0-128-249 kubenswrapper[2558]: I0708 16:09:10.433268 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-58zvw_c7198ffb-8622-414a-8462-6537510922d4/kube-rbac-proxy/0.log"