Jun 10 12:00:25.951209 ip-10-0-143-32 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 12:00:25.951219 ip-10-0-143-32 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 12:00:25.951227 ip-10-0-143-32 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 12:00:25.951426 ip-10-0-143-32 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 12:00:36.017251 ip-10-0-143-32 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 12:00:36.017265 ip-10-0-143-32 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 7359866829694319b8340354455ba9e3 -- Jun 10 12:03:25.287195 ip-10-0-143-32 systemd[1]: Starting Kubernetes Kubelet... Jun 10 12:03:25.733528 ip-10-0-143-32 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:25.733528 ip-10-0-143-32 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 12:03:25.733528 ip-10-0-143-32 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:25.733528 ip-10-0-143-32 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 12:03:25.733528 ip-10-0-143-32 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:25.734843 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.734757 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 12:03:25.739553 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739530 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.739553 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739550 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739555 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739568 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739574 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739578 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739582 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739587 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739591 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739596 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739600 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739604 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739608 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739612 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739616 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739624 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739628 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739632 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739637 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739643 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739652 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.739681 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739658 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739662 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739666 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739670 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739675 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739679 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739688 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739693 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739697 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739702 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739707 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739711 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739714 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739718 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739723 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739727 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739731 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739735 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739743 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739747 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.740444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739752 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739756 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739759 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739763 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739767 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739771 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739775 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739780 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739784 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739788 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739793 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739801 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739805 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739811 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739815 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739819 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739823 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739830 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739835 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.741210 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739840 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739845 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739853 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739863 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739867 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739872 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739876 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739880 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739885 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739889 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739893 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739897 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739901 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739905 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739909 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739914 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739922 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739926 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739950 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.742014 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739954 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739958 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739963 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739967 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739971 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739975 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739980 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739985 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739990 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.739994 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740003 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740007 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740011 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740016 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740020 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740024 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740028 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740032 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740036 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.740040 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.742757 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741570 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741595 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741601 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741605 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741611 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741617 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741623 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741628 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741632 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741637 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741641 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741646 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741651 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741655 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741659 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741663 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741667 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741671 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741676 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741680 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.743616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741685 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741690 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741694 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741698 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741703 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741707 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741711 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741715 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741719 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741723 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741728 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741732 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741736 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741742 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741747 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741751 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741755 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741760 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741765 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741769 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.744581 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741774 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741778 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741782 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741788 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741794 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741799 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741803 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741808 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741812 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741816 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741820 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741824 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741828 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741832 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741837 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741841 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741845 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741849 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741853 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.745130 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741857 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741861 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741866 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741870 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741873 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741877 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741882 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741887 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741893 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741897 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741901 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741905 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741909 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741913 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741917 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741921 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741925 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741945 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741949 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741953 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.745678 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741957 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741961 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741965 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741969 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741974 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741978 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741984 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741991 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.741996 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742000 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742004 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742008 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742012 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742016 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742020 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742024 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742028 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742032 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742036 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.746285 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742041 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742691 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742702 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742707 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742712 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742716 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742720 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742724 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742729 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742733 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742737 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742741 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742745 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742749 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742753 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742758 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742762 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742766 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742771 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742775 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.746874 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742778 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742782 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742786 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742790 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742794 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742801 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742806 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742810 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742814 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742818 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742822 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742829 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742834 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742838 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742842 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742846 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742850 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742854 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742858 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.747371 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742862 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742866 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742870 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742874 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742878 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742882 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742888 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742892 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742896 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742900 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742903 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742909 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742913 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742917 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742921 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742925 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742947 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742954 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742960 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.747949 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742965 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742970 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742975 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742980 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742985 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742990 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742994 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.742999 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743003 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743007 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743011 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743016 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743020 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743026 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743030 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743034 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743038 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743042 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743047 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.748406 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743052 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743056 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743060 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743064 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743068 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743072 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743078 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743082 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743086 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743090 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743095 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743099 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743103 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743107 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743111 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743115 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743119 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743123 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743128 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743133 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.748879 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743137 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743141 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.743145 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743237 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743247 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743255 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743262 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743268 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743273 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743279 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743286 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743290 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743295 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743300 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743306 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743310 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743315 2576 flags.go:64] FLAG: --cgroup-root="" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743320 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743324 2576 flags.go:64] FLAG: --client-ca-file="" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743331 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743336 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743343 2576 flags.go:64] FLAG: --cluster-domain="" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743348 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743353 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 12:03:25.749410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743358 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743363 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743369 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743374 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743379 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743384 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743389 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743394 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743399 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743404 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743409 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743415 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743420 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743424 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743429 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743434 2576 flags.go:64] FLAG: --enable-server="true" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743438 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743444 2576 flags.go:64] FLAG: --event-burst="100" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743449 2576 flags.go:64] FLAG: --event-qps="50" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743454 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743459 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743464 2576 flags.go:64] FLAG: --eviction-hard="" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743470 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743474 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743479 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 12:03:25.749996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743484 2576 flags.go:64] FLAG: --eviction-soft="" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743489 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743493 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743498 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743503 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743508 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743512 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743516 2576 flags.go:64] FLAG: --feature-gates="" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743522 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743527 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743531 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743536 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743541 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743546 2576 flags.go:64] FLAG: --help="false" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743551 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-143-32.ec2.internal" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743556 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743561 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743565 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743571 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743576 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743580 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743585 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743589 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 12:03:25.750582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743594 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743598 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743603 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743608 2576 flags.go:64] FLAG: --kube-reserved="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743612 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743616 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743620 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743625 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743629 2576 flags.go:64] FLAG: --lock-file="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743634 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743639 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743643 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743652 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743658 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743662 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743667 2576 flags.go:64] FLAG: --logging-format="text" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743671 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743676 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743680 2576 flags.go:64] FLAG: --manifest-url="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743685 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743691 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743696 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743703 2576 flags.go:64] FLAG: --max-pods="110" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743707 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743712 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 12:03:25.751310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743716 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743720 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743725 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743730 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743734 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743748 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743753 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743759 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743763 2576 flags.go:64] FLAG: --pod-cidr="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743767 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743776 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743783 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743788 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743792 2576 flags.go:64] FLAG: --port="10250" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743796 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743801 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00c176ef4e6ca0353" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743806 2576 flags.go:64] FLAG: --qos-reserved="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743811 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743815 2576 flags.go:64] FLAG: --register-node="true" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743820 2576 flags.go:64] FLAG: --register-with-taints="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743825 2576 flags.go:64] FLAG: --registry-burst="10" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743831 2576 flags.go:64] FLAG: --registry-qps="5" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743836 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743840 2576 flags.go:64] FLAG: --reserved-memory="" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743846 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 12:03:25.751907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743851 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743856 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743861 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743865 2576 flags.go:64] FLAG: --runonce="false" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743869 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743874 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743879 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743883 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743888 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743893 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743897 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743902 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743908 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743912 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743917 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743921 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743926 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743948 2576 flags.go:64] FLAG: --system-cgroups="" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743954 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743963 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743968 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743972 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743979 2576 flags.go:64] FLAG: --tls-min-version="" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743983 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743988 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 12:03:25.752532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743993 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.743997 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.744002 2576 flags.go:64] FLAG: --v="2" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.744008 2576 flags.go:64] FLAG: --version="false" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.744015 2576 flags.go:64] FLAG: --vmodule="" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.744021 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.744026 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744231 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744240 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744245 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744249 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744254 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744258 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744262 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744267 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744271 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744275 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744280 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744284 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744290 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744294 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.753138 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744298 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744302 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744306 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744310 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744316 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744320 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744324 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744328 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744333 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744337 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744341 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744345 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744349 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744353 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744358 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744362 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744367 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744371 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744375 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744379 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.753639 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744383 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744388 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744392 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744396 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744400 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744404 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744408 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744412 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744416 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744420 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744426 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744430 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744435 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744439 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744443 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744447 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744453 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744457 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744462 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744466 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.754133 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744470 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744474 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744478 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744482 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744486 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744491 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744495 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744498 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744503 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744507 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744514 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744521 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744527 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744531 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744535 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744539 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744543 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744547 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744551 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.754608 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744556 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744560 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744564 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744573 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744577 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744580 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744584 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744588 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744591 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744597 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744601 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744607 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744613 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744618 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744622 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744626 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744630 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744634 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744638 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744642 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.755076 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744646 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744650 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744654 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744659 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744664 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.744668 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.745422 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.752232 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.752248 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.753316 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.753324 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753389 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753393 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753396 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.755544 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753400 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753403 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753405 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753408 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753411 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753414 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753416 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753419 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753423 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753427 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753430 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753433 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753436 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753439 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753441 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753444 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753447 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753449 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753451 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.755872 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753454 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753457 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753459 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753462 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753464 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753467 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753469 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753473 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753476 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753478 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753481 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753483 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753486 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753489 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753491 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753494 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753496 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753499 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753501 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753504 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.756444 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753506 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753509 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753513 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753517 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753519 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753522 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753524 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753527 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753529 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753532 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753534 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753537 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753539 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753541 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753544 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753546 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753549 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753551 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753554 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.756903 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753558 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753561 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753564 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753566 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753569 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753571 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753574 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753586 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753589 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753591 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753594 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753596 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753599 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753601 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753604 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753606 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753608 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753611 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753613 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753616 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.757359 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753618 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753621 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753623 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753626 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753628 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753631 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753633 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753635 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753638 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753640 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753643 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753646 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753649 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753652 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753656 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753658 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753661 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.757836 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753665 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.753670 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753797 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753802 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753805 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753808 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753811 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753813 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753815 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753818 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753821 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753823 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753825 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753828 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753830 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:25.758252 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753832 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753835 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753837 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753839 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753842 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753844 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753846 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753849 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753852 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753854 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753857 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753859 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753862 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753864 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753867 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753873 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753876 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753879 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753881 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753884 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:25.758606 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753886 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753889 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753892 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753894 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753897 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753899 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753901 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753905 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753909 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753911 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753914 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753916 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753919 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753922 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753924 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753927 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753942 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753944 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753947 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:25.759123 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753951 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753954 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753957 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753960 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753964 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753967 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753970 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753973 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753975 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753979 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753982 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753984 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753987 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753989 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753992 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753995 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.753998 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754000 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754003 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754005 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:25.759568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754008 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754010 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754013 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754015 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754017 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754020 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754023 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754025 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754028 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754031 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754033 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754036 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754038 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754041 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754043 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754045 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754049 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754051 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754055 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754057 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:25.760052 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754060 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754063 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754068 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754071 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754074 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754077 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:25.754079 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.754084 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.754184 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.757291 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.758817 2576 server.go:1019] "Starting client certificate rotation" Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.758917 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:03:25.760520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.758968 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:03:25.761665 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.761652 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:03:25.763655 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.763640 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:03:25.776778 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.776615 2576 log.go:25] "Validated CRI v1 runtime API" Jun 10 12:03:25.780033 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.780016 2576 log.go:25] "Validated CRI v1 image API" Jun 10 12:03:25.781355 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.781333 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 12:03:25.784295 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.784275 2576 fs.go:135] Filesystem UUIDs: map[72c8fb43-bb0c-411b-81cf-4e94f256547a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a9f20be6-b172-453a-86a6-264cba55aa4b:/dev/nvme0n1p3] Jun 10 12:03:25.784353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.784294 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 12:03:25.786926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.786909 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:03:25.790590 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.790483 2576 manager.go:216] Machine: {Timestamp:2026-06-10 12:03:25.788152133 +0000 UTC m=+0.376498982 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3201328 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22e21d6ecb6f7955a67a52b854fae1 SystemUUID:ec22e21d-6ecb-6f79-55a6-7a52b854fae1 BootID:73598668-2969-4319-b834-0354455ba9e3 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:43:9c:77:a9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:43:9c:77:a9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:51:26:7a:b0:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 12:03:25.790590 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.790580 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 12:03:25.790729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.790659 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 12:03:25.793828 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.793807 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 12:03:25.793979 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.793831 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-32.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 12:03:25.794488 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.794479 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 12:03:25.794518 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.794490 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 12:03:25.794518 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.794498 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:03:25.795390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.795380 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:03:25.796167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.796157 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 12:03:25.799055 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799044 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:03:25.799164 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799155 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 12:03:25.799201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799183 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 10 12:03:25.799201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799192 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 12:03:25.799201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799201 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 12:03:25.799300 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799209 2576 kubelet.go:398] "Adding apiserver pod source" Jun 10 12:03:25.799300 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799218 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 12:03:25.799553 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799542 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:03:25.799588 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.799562 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:03:25.802314 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.802294 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 12:03:25.803657 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.803644 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 12:03:25.803718 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.803673 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 12:03:25.804834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804823 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804839 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804845 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804850 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804859 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804864 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 12:03:25.804871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804872 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 12:03:25.805046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804877 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 12:03:25.805046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804883 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 12:03:25.805046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804888 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 12:03:25.805046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804896 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 12:03:25.805046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.804901 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 12:03:25.806460 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.806446 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 12:03:25.806460 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.806457 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 12:03:25.808493 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.808475 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8nfp2" Jun 10 12:03:25.809426 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.809413 2576 server.go:1268] "Started kubelet" Jun 10 12:03:25.809590 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.809503 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 12:03:25.809686 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.809608 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 12:03:25.809686 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.809635 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 12:03:25.810347 ip-10-0-143-32 systemd[1]: Started Kubernetes Kubelet. Jun 10 12:03:25.811254 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.811236 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-32.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 12:03:25.811319 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.811285 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 12:03:25.811448 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.811287 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 12:03:25.811546 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.811531 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 12:03:25.811593 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.811549 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 10 12:03:25.817478 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.817457 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8nfp2" Jun 10 12:03:25.817832 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.817817 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 12:03:25.819518 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.815267 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-32.ec2.internal.18b7b6a6f33388dd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-32.ec2.internal,UID:ip-10-0-143-32.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-32.ec2.internal,},FirstTimestamp:2026-06-10 12:03:25.809387741 +0000 UTC m=+0.397734590,LastTimestamp:2026-06-10 12:03:25.809387741 +0000 UTC m=+0.397734590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-32.ec2.internal,}" Jun 10 12:03:25.819856 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.819828 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 12:03:25.819953 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.819869 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 12:03:25.819953 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.819922 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:25.820621 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820602 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 12:03:25.820621 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820621 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 12:03:25.820772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820634 2576 factory.go:55] Registering systemd factory Jun 10 12:03:25.820772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820648 2576 factory.go:223] Registration of the systemd container factory successfully Jun 10 12:03:25.820772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820610 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 12:03:25.820772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820728 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 10 12:03:25.820772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820733 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 10 12:03:25.820981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820878 2576 factory.go:153] Registering CRI-O factory Jun 10 12:03:25.820981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820892 2576 factory.go:223] Registration of the crio container factory successfully Jun 10 12:03:25.821060 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.820990 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 12:03:25.821060 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.821012 2576 factory.go:103] Registering Raw factory Jun 10 12:03:25.821060 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.821025 2576 manager.go:1196] Started watching for new ooms in manager Jun 10 12:03:25.821425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.821410 2576 manager.go:349] Starting recovery of all containers Jun 10 12:03:25.821921 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.821891 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 12:03:25.822053 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.822035 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-32.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 12:03:25.831215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.831108 2576 manager.go:354] Recovery completed Jun 10 12:03:25.835323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.835311 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.837138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837123 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.837223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837155 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.837223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837169 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.837664 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837651 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 12:03:25.837664 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837662 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 12:03:25.837767 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837664 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.837767 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.837676 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:03:25.838385 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838371 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.838436 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838398 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.838436 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838407 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.838763 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838750 2576 policy_none.go:49] "None policy: Start" Jun 10 12:03:25.838763 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838764 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 12:03:25.838868 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.838774 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 12:03:25.840000 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.839990 2576 policy_none.go:47] "Start" Jun 10 12:03:25.872520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.872504 2576 manager.go:337] "Starting Device Plugin manager" Jun 10 12:03:25.872612 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.872555 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 12:03:25.872612 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.872568 2576 server.go:87] "Starting device plugin registration server" Jun 10 12:03:25.872842 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.872826 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 12:03:25.872965 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.872844 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 12:03:25.872965 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.872920 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 12:03:25.873052 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.873016 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 12:03:25.873052 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.873026 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 12:03:25.874002 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.873979 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 12:03:25.874087 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.874035 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:25.891918 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.891895 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 12:03:25.910027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.893064 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 12:03:25.910027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.893098 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 12:03:25.910027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.893122 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 12:03:25.910027 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.893154 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 12:03:25.910027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.894633 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:25.973721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.973690 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.974760 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.974744 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.974857 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.974779 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.974857 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.974793 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.974857 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.974822 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-32.ec2.internal" Jun 10 12:03:25.980154 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.980138 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-32.ec2.internal" Jun 10 12:03:25.980243 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.980162 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-32.ec2.internal\": node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:25.993555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.993500 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal"] Jun 10 12:03:25.993555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.993554 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.994261 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.994246 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.994317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.994272 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.994317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.994281 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.995162 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:25.995149 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:25.995495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.995484 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.995608 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.995593 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:25.995769 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.995628 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.996152 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996138 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.996248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996162 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.996248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996171 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.996248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996198 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.996248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996220 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.996248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.996234 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:25.997702 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.997687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:25.997782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.997715 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:25.998410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.998396 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:25.998478 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.998421 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:25.998478 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:25.998432 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:26.021573 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.021553 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-32.ec2.internal\" not found" node="ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.022262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.022245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.022339 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.022270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.022339 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.022295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c4192ae489bc32c73b2d3c76f561d8f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-32.ec2.internal\" (UID: \"1c4192ae489bc32c73b2d3c76f561d8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.025860 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.025845 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-32.ec2.internal\" not found" node="ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.095517 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.095494 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.123244 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.123338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123246 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c4192ae489bc32c73b2d3c76f561d8f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-32.ec2.internal\" (UID: \"1c4192ae489bc32c73b2d3c76f561d8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.123338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.123338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.123338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a160c4236c93af34a314177143b85dc-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal\" (UID: \"2a160c4236c93af34a314177143b85dc\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.123338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.123320 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1c4192ae489bc32c73b2d3c76f561d8f-config\") pod \"kube-apiserver-proxy-ip-10-0-143-32.ec2.internal\" (UID: \"1c4192ae489bc32c73b2d3c76f561d8f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.196108 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.196079 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.296829 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.296749 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.326335 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.326314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.330127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.330104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:26.397720 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.397693 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.498169 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.498143 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.598742 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.598681 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.699163 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.699135 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.757757 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.757731 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 12:03:26.758421 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.757901 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:03:26.800043 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.800016 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:26.811785 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:26.811742 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c4192ae489bc32c73b2d3c76f561d8f.slice/crio-8aeb8f4da0df58d9a14b437fcc057d041c4ef6d85fbff8a2ac799843e7393c02 WatchSource:0}: Error finding container 8aeb8f4da0df58d9a14b437fcc057d041c4ef6d85fbff8a2ac799843e7393c02: Status 404 returned error can't find the container with id 8aeb8f4da0df58d9a14b437fcc057d041c4ef6d85fbff8a2ac799843e7393c02 Jun 10 12:03:26.812005 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:26.811985 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a160c4236c93af34a314177143b85dc.slice/crio-0a9067a85c92bdb73cc2bf6ab3ab87e9f4480d4ebafb45f3971c6a4aa7fb4110 WatchSource:0}: Error finding container 0a9067a85c92bdb73cc2bf6ab3ab87e9f4480d4ebafb45f3971c6a4aa7fb4110: Status 404 returned error can't find the container with id 0a9067a85c92bdb73cc2bf6ab3ab87e9f4480d4ebafb45f3971c6a4aa7fb4110 Jun 10 12:03:26.816280 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.816264 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:03:26.822342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.822307 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:58:25 +0000 UTC" deadline="2028-02-13 00:43:22.740870117 +0000 UTC" Jun 10 12:03:26.822419 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.822342 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14700h39m55.918531689s" Jun 10 12:03:26.896617 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.896530 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" event={"ID":"1c4192ae489bc32c73b2d3c76f561d8f","Type":"ContainerStarted","Data":"8aeb8f4da0df58d9a14b437fcc057d041c4ef6d85fbff8a2ac799843e7393c02"} Jun 10 12:03:26.897523 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:26.897498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" event={"ID":"2a160c4236c93af34a314177143b85dc","Type":"ContainerStarted","Data":"0a9067a85c92bdb73cc2bf6ab3ab87e9f4480d4ebafb45f3971c6a4aa7fb4110"} Jun 10 12:03:26.900664 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:26.900649 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.001168 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.001128 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.101708 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.101678 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.202208 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.202145 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.280632 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.280608 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:27.289987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.289966 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:27.302357 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.302329 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.402995 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.402956 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-32.ec2.internal\" not found" Jun 10 12:03:27.409133 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.408970 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:27.420428 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.420357 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" Jun 10 12:03:27.431387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.431281 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:03:27.432859 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.432700 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" Jun 10 12:03:27.439785 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.439701 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:03:27.800745 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.800714 2576 apiserver.go:52] "Watching apiserver" Jun 10 12:03:27.808539 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.808514 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 12:03:27.811638 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.811612 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal","openshift-multus/network-metrics-daemon-mgf74","openshift-ovn-kubernetes/ovnkube-node-fxflh","kube-system/konnectivity-agent-w4vtv","kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal","openshift-cluster-node-tuning-operator/tuned-frbbv","openshift-dns/node-resolver-k5p87","openshift-multus/multus-additional-cni-plugins-f9j8k","openshift-multus/multus-ktjnt","openshift-network-diagnostics/network-check-target-qf9vf","openshift-network-operator/iptables-alerter-88n7p","kube-system/global-pull-secret-syncer-qsd5d","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb","openshift-image-registry/node-ca-zjdl4"] Jun 10 12:03:27.813053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.813032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.815545 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.815171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.815642 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.815627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 12:03:27.816672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.816538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 12:03:27.816672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.816633 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5m77r\"" Jun 10 12:03:27.817897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.816989 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.817897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.817591 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 12:03:27.817897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.817869 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.818421 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.818389 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 12:03:27.818421 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.818407 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.818710 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.818693 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mj8rs\"" Jun 10 12:03:27.820169 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.819807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.820534 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.820383 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 12:03:27.820758 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.820699 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hgscp\"" Jun 10 12:03:27.821672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.821433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.821908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.821891 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.821997 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.821916 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.823075 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.822898 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 12:03:27.823075 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.822968 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 12:03:27.823075 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.822995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-57mpp\"" Jun 10 12:03:27.823075 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.822900 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.823982 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.823966 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.824129 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.824115 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 12:03:27.824451 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.824433 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 12:03:27.824738 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.824719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.824814 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.824751 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7wzrb\"" Jun 10 12:03:27.824997 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.824979 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.825078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.825018 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.825867 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.825615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:27.825867 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.825699 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:27.826363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.826320 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hqm9\"" Jun 10 12:03:27.826475 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.826457 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 12:03:27.827317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.827177 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 12:03:27.827446 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.827341 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:27.827446 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.827392 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:27.828573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.828555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:27.830317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.830199 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:27.830317 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:27.830268 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:27.831127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.831098 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 12:03:27.831127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.831107 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.831261 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.831197 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zn47\"" Jun 10 12:03:27.831333 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.831318 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.831601 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.831549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.832646 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.832619 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:03:27.833018 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.832981 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-multus-daemon-config\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.833126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833021 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-socket-dir-parent\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.833126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833046 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be82b18-301f-4fdc-b41c-49295824e59f-tmp-dir\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.833126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-node-log\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-script-lib\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-lib-modules\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-cni-binary-copy\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-kubelet\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833214 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/059ab479-e5ad-48e1-af81-bb11ea2d77cd-konnectivity-ca\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8be82b18-301f-4fdc-b41c-49295824e59f-hosts-file\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833273 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-conf\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-multus-certs\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqkb\" (UniqueName: \"kubernetes.io/projected/8be82b18-301f-4fdc-b41c-49295824e59f-kube-api-access-4jqkb\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.833387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833358 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-log-socket\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgb5j\" (UniqueName: \"kubernetes.io/projected/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-kube-api-access-xgb5j\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-system-cni-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833498 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-os-release\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-systemd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833649 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovn-node-metrics-cert\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-sys\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833697 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-tmp\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-ovn\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833764 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-bin\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.833825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-var-lib-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-etc-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833912 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-modprobe-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysconfig\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-conf-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-config\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.833179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-env-overrides\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-cnibin\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-systemd-units\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834113 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-slash\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-systemd\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834191 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-var-lib-kubelet\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834220 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94kct\" (UniqueName: \"kubernetes.io/projected/418ef8f8-d194-480d-a185-f6588cbe2296-kube-api-access-94kct\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lsgt\" (UniqueName: \"kubernetes.io/projected/f7b585af-6f0e-4829-817d-1de83e444980-kube-api-access-2lsgt\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-netns\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.834459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834289 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-kubelet\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-netns\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-netd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-etc-tuned\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-cnibin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-os-release\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834416 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q5cpt\"" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-hostroot\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-etc-kubernetes\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834632 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-kubernetes\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-multus\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-host\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.835251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/059ab479-e5ad-48e1-af81-bb11ea2d77cd-agent-certs\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834897 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-system-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-run\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.834979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-k8s-cni-cncf-io\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.835003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lj7g\" (UniqueName: \"kubernetes.io/projected/850947fe-3e58-4508-b491-405a5225641b-kube-api-access-5lj7g\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.835024 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.835987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.835048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-bin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.836330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.836315 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 12:03:27.836899 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.836880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bzv5w\"" Jun 10 12:03:27.837176 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.837159 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 12:03:27.837244 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.837167 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 12:03:27.903415 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.903395 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbb6s" Jun 10 12:03:27.910896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.910876 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mbb6s" Jun 10 12:03:27.921452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.921429 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 12:03:27.935764 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-bin\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-device-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935822 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-var-lib-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-etc-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-modprobe-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.935896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysconfig\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935910 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13efa946-6bbc-41c2-9204-5c03dba07e39-iptables-alerter-script\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-conf-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-config\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-modprobe-d\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936041 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-env-overrides\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936063 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-var-lib-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-cnibin\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.935859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-bin\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936094 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-socket-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936116 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-cnibin\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-systemd-units\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936144 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-slash\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936166 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-systemd\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-systemd-units\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-var-lib-kubelet\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94kct\" (UniqueName: \"kubernetes.io/projected/418ef8f8-d194-480d-a185-f6588cbe2296-kube-api-access-94kct\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936215 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-etc-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lsgt\" (UniqueName: \"kubernetes.io/projected/f7b585af-6f0e-4829-817d-1de83e444980-kube-api-access-2lsgt\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-netns\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936265 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-systemd\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-kubelet\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936305 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-netns\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-netd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936352 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-etc-tuned\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae6c156d-7315-4279-9950-ff2e9b42da0b-host\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-cnibin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-os-release\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936447 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-hostroot\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936470 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-etc-kubernetes\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.936957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-kubernetes\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13efa946-6bbc-41c2-9204-5c03dba07e39-host-slash\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936590 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-multus\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-config\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936613 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-host\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936664 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-sys-fs\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysconfig\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936738 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtfg\" (UniqueName: \"kubernetes.io/projected/9589b3eb-7a7a-4721-b42a-77096aa5da58-kube-api-access-zmtfg\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-env-overrides\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/059ab479-e5ad-48e1-af81-bb11ea2d77cd-agent-certs\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-slash\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-system-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936849 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-var-lib-kubelet\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936865 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-run\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.937810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936873 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-host\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-k8s-cni-cncf-io\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-hostroot\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936923 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lj7g\" (UniqueName: \"kubernetes.io/projected/850947fe-3e58-4508-b491-405a5225641b-kube-api-access-5lj7g\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-etc-kubernetes\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-bin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-multus-daemon-config\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-kubernetes\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-multus\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937125 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-k8s-cni-cncf-io\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-openvswitch\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-ovn-kubernetes\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-run-netns\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-netns\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-kubelet\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.938628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-system-cni-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937374 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-host-cni-netd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937442 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-cnibin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-run\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937552 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-os-release\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.936799 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-conf-dir\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937589 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-kubelet-config\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937606 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-binary-copy\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-socket-dir-parent\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-multus-daemon-config\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be82b18-301f-4fdc-b41c-49295824e59f-tmp-dir\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937658 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937671 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-cni-bin\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937662 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-multus-socket-dir-parent\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937711 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-tuning-conf-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-node-log\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-script-lib\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-node-log\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.939480 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-lib-modules\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.937987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl4bj\" (UniqueName: \"kubernetes.io/projected/13efa946-6bbc-41c2-9204-5c03dba07e39-kube-api-access-kl4bj\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938003 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8be82b18-301f-4fdc-b41c-49295824e59f-tmp-dir\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-lib-modules\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-cni-binary-copy\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-kubelet\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938090 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6b8s\" (UniqueName: \"kubernetes.io/projected/ae6c156d-7315-4279-9950-ff2e9b42da0b-kube-api-access-p6b8s\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938099 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-var-lib-kubelet\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938172 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/059ab479-e5ad-48e1-af81-bb11ea2d77cd-konnectivity-ca\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8be82b18-301f-4fdc-b41c-49295824e59f-hosts-file\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-conf\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-registration-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938431 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovnkube-script-lib\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.940332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938492 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-multus-certs\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8be82b18-301f-4fdc-b41c-49295824e59f-hosts-file\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-etc-sysctl-conf\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqkb\" (UniqueName: \"kubernetes.io/projected/8be82b18-301f-4fdc-b41c-49295824e59f-kube-api-access-4jqkb\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/850947fe-3e58-4508-b491-405a5225641b-host-run-multus-certs\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/850947fe-3e58-4508-b491-405a5225641b-cni-binary-copy\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-log-socket\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938618 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae6c156d-7315-4279-9950-ff2e9b42da0b-serviceca\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-log-socket\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938686 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgb5j\" (UniqueName: \"kubernetes.io/projected/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-kube-api-access-xgb5j\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-system-cni-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/059ab479-e5ad-48e1-af81-bb11ea2d77cd-konnectivity-ca\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-os-release\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938794 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-system-cni-dir\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938898 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938956 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-dbus\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:27.942137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcr5\" (UniqueName: \"kubernetes.io/projected/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-kube-api-access-trcr5\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.938998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f7b585af-6f0e-4829-817d-1de83e444980-os-release\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-systemd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovn-node-metrics-cert\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939057 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-systemd\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-sys\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-tmp\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-ovn\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-run-ovn\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/418ef8f8-d194-480d-a185-f6588cbe2296-sys\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.939298 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f7b585af-6f0e-4829-817d-1de83e444980-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.941429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/059ab479-e5ad-48e1-af81-bb11ea2d77cd-agent-certs\") pod \"konnectivity-agent-w4vtv\" (UID: \"059ab479-e5ad-48e1-af81-bb11ea2d77cd\") " pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.941611 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-tmp\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.941743 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/418ef8f8-d194-480d-a185-f6588cbe2296-etc-tuned\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.942926 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.942550 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-ovn-node-metrics-cert\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.945634 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.945502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94kct\" (UniqueName: \"kubernetes.io/projected/418ef8f8-d194-480d-a185-f6588cbe2296-kube-api-access-94kct\") pod \"tuned-frbbv\" (UID: \"418ef8f8-d194-480d-a185-f6588cbe2296\") " pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:27.946076 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.946053 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lj7g\" (UniqueName: \"kubernetes.io/projected/850947fe-3e58-4508-b491-405a5225641b-kube-api-access-5lj7g\") pod \"multus-ktjnt\" (UID: \"850947fe-3e58-4508-b491-405a5225641b\") " pod="openshift-multus/multus-ktjnt" Jun 10 12:03:27.946473 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.946455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lsgt\" (UniqueName: \"kubernetes.io/projected/f7b585af-6f0e-4829-817d-1de83e444980-kube-api-access-2lsgt\") pod \"multus-additional-cni-plugins-f9j8k\" (UID: \"f7b585af-6f0e-4829-817d-1de83e444980\") " pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:27.947159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.947141 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgb5j\" (UniqueName: \"kubernetes.io/projected/b3cba19f-bf89-44d0-9369-fcf7e2ae5a45-kube-api-access-xgb5j\") pod \"ovnkube-node-fxflh\" (UID: \"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45\") " pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:27.947752 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:27.947729 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqkb\" (UniqueName: \"kubernetes.io/projected/8be82b18-301f-4fdc-b41c-49295824e59f-kube-api-access-4jqkb\") pod \"node-resolver-k5p87\" (UID: \"8be82b18-301f-4fdc-b41c-49295824e59f\") " pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:28.039888 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.039857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6b8s\" (UniqueName: \"kubernetes.io/projected/ae6c156d-7315-4279-9950-ff2e9b42da0b-kube-api-access-p6b8s\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.039888 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.039893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.040126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.039916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:28.040126 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.040023 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.040126 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.040036 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:28.040126 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.040096 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.540074534 +0000 UTC m=+3.128421373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.040126 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.040116 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.540104573 +0000 UTC m=+3.128451410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-registration-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae6c156d-7315-4279-9950-ff2e9b42da0b-serviceca\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040187 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-dbus\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040233 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcr5\" (UniqueName: \"kubernetes.io/projected/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-kube-api-access-trcr5\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040282 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-registration-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-device-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-dbus\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-device-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040456 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13efa946-6bbc-41c2-9204-5c03dba07e39-iptables-alerter-script\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-socket-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040506 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae6c156d-7315-4279-9950-ff2e9b42da0b-host\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040565 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ae6c156d-7315-4279-9950-ff2e9b42da0b-host\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.040631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040593 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13efa946-6bbc-41c2-9204-5c03dba07e39-host-slash\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040637 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-sys-fs\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040660 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtfg\" (UniqueName: \"kubernetes.io/projected/9589b3eb-7a7a-4721-b42a-77096aa5da58-kube-api-access-zmtfg\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-socket-dir\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/13efa946-6bbc-41c2-9204-5c03dba07e39-host-slash\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ae6c156d-7315-4279-9950-ff2e9b42da0b-serviceca\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040717 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-kubelet-config\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040735 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-etc-selinux\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9589b3eb-7a7a-4721-b42a-77096aa5da58-sys-fs\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl4bj\" (UniqueName: \"kubernetes.io/projected/13efa946-6bbc-41c2-9204-5c03dba07e39-kube-api-access-kl4bj\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.041061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.040758 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-kubelet-config\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.041452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.041065 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/13efa946-6bbc-41c2-9204-5c03dba07e39-iptables-alerter-script\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.049103 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.048948 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:28.049103 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.048970 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:28.049103 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.048982 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.049103 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.049045 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.549029083 +0000 UTC m=+3.137375944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.051512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.051459 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtfg\" (UniqueName: \"kubernetes.io/projected/9589b3eb-7a7a-4721-b42a-77096aa5da58-kube-api-access-zmtfg\") pod \"aws-ebs-csi-driver-node-8xtzb\" (UID: \"9589b3eb-7a7a-4721-b42a-77096aa5da58\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.051675 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.051656 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl4bj\" (UniqueName: \"kubernetes.io/projected/13efa946-6bbc-41c2-9204-5c03dba07e39-kube-api-access-kl4bj\") pod \"iptables-alerter-88n7p\" (UID: \"13efa946-6bbc-41c2-9204-5c03dba07e39\") " pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.051818 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.051795 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcr5\" (UniqueName: \"kubernetes.io/projected/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-kube-api-access-trcr5\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:28.051818 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.051806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6b8s\" (UniqueName: \"kubernetes.io/projected/ae6c156d-7315-4279-9950-ff2e9b42da0b-kube-api-access-p6b8s\") pod \"node-ca-zjdl4\" (UID: \"ae6c156d-7315-4279-9950-ff2e9b42da0b\") " pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.126190 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.126159 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:28.136243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.136224 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ktjnt" Jun 10 12:03:28.143887 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.143860 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5p87" Jun 10 12:03:28.148576 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.148551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:28.155572 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.155555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-frbbv" Jun 10 12:03:28.161983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.161964 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" Jun 10 12:03:28.171356 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.171340 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-88n7p" Jun 10 12:03:28.178042 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.178024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" Jun 10 12:03:28.184071 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.184054 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zjdl4" Jun 10 12:03:28.289159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.289135 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:28.418842 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.418617 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod850947fe_3e58_4508_b491_405a5225641b.slice/crio-bd4df43ac3194d8d01af531eff857453e58b538ce4a5fad1ffb2414294654880 WatchSource:0}: Error finding container bd4df43ac3194d8d01af531eff857453e58b538ce4a5fad1ffb2414294654880: Status 404 returned error can't find the container with id bd4df43ac3194d8d01af531eff857453e58b538ce4a5fad1ffb2414294654880 Jun 10 12:03:28.421662 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.421547 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418ef8f8_d194_480d_a185_f6588cbe2296.slice/crio-c877c7f8f6fb42b79ad9cb8547ca487411f973fe74a9122062b9f9b4ea6f0815 WatchSource:0}: Error finding container c877c7f8f6fb42b79ad9cb8547ca487411f973fe74a9122062b9f9b4ea6f0815: Status 404 returned error can't find the container with id c877c7f8f6fb42b79ad9cb8547ca487411f973fe74a9122062b9f9b4ea6f0815 Jun 10 12:03:28.424073 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.424052 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6c156d_7315_4279_9950_ff2e9b42da0b.slice/crio-067f912e9c47eef5793051313cf1df01b85178201dfe9d67302c79d9f84a6a93 WatchSource:0}: Error finding container 067f912e9c47eef5793051313cf1df01b85178201dfe9d67302c79d9f84a6a93: Status 404 returned error can't find the container with id 067f912e9c47eef5793051313cf1df01b85178201dfe9d67302c79d9f84a6a93 Jun 10 12:03:28.424926 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.424724 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be82b18_301f_4fdc_b41c_49295824e59f.slice/crio-92e98afaca36715a0b3bdd3d53f625c084c1b92edb46f577632529183d12dcc8 WatchSource:0}: Error finding container 92e98afaca36715a0b3bdd3d53f625c084c1b92edb46f577632529183d12dcc8: Status 404 returned error can't find the container with id 92e98afaca36715a0b3bdd3d53f625c084c1b92edb46f577632529183d12dcc8 Jun 10 12:03:28.426607 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.426584 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13efa946_6bbc_41c2_9204_5c03dba07e39.slice/crio-4af68c2bd1ffdd487c3e257c45fd8c6d7695aa0dde8178437e48999b125168a5 WatchSource:0}: Error finding container 4af68c2bd1ffdd487c3e257c45fd8c6d7695aa0dde8178437e48999b125168a5: Status 404 returned error can't find the container with id 4af68c2bd1ffdd487c3e257c45fd8c6d7695aa0dde8178437e48999b125168a5 Jun 10 12:03:28.427007 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.426981 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod059ab479_e5ad_48e1_af81_bb11ea2d77cd.slice/crio-ccbbda549745eea4c6970c5abe6950099ffbcb5c4086fae02fbafd526c0f505c WatchSource:0}: Error finding container ccbbda549745eea4c6970c5abe6950099ffbcb5c4086fae02fbafd526c0f505c: Status 404 returned error can't find the container with id ccbbda549745eea4c6970c5abe6950099ffbcb5c4086fae02fbafd526c0f505c Jun 10 12:03:28.427924 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.427684 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3cba19f_bf89_44d0_9369_fcf7e2ae5a45.slice/crio-dec2037482bfc46150aae4e36a9cc9920d0bbdcb9c210c976f30078c50e9c71f WatchSource:0}: Error finding container dec2037482bfc46150aae4e36a9cc9920d0bbdcb9c210c976f30078c50e9c71f: Status 404 returned error can't find the container with id dec2037482bfc46150aae4e36a9cc9920d0bbdcb9c210c976f30078c50e9c71f Jun 10 12:03:28.430277 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.430258 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9589b3eb_7a7a_4721_b42a_77096aa5da58.slice/crio-4ead78097b85122652c404f05be97fac8f0ebfad73a3298f9f756255acba53a5 WatchSource:0}: Error finding container 4ead78097b85122652c404f05be97fac8f0ebfad73a3298f9f756255acba53a5: Status 404 returned error can't find the container with id 4ead78097b85122652c404f05be97fac8f0ebfad73a3298f9f756255acba53a5 Jun 10 12:03:28.431004 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:03:28.430916 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b585af_6f0e_4829_817d_1de83e444980.slice/crio-80b672e49d3831c3ad6b178a268af60134922a7aff2377a0f30491705a35ca73 WatchSource:0}: Error finding container 80b672e49d3831c3ad6b178a268af60134922a7aff2377a0f30491705a35ca73: Status 404 returned error can't find the container with id 80b672e49d3831c3ad6b178a268af60134922a7aff2377a0f30491705a35ca73 Jun 10 12:03:28.545317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.545282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:28.545317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.545314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:28.545496 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.545431 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.545496 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.545433 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:28.545496 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.545476 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:29.545464159 +0000 UTC m=+4.133811010 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.545496 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.545488 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:29.545482086 +0000 UTC m=+4.133828923 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:28.646217 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.646180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:28.646351 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.646337 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:28.646419 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.646357 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:28.646419 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.646370 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.646492 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.646429 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:29.646411601 +0000 UTC m=+4.234758452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.893969 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.893874 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:28.894314 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:28.893993 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:28.904737 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.904709 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4vtv" event={"ID":"059ab479-e5ad-48e1-af81-bb11ea2d77cd","Type":"ContainerStarted","Data":"ccbbda549745eea4c6970c5abe6950099ffbcb5c4086fae02fbafd526c0f505c"} Jun 10 12:03:28.905631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.905609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5p87" event={"ID":"8be82b18-301f-4fdc-b41c-49295824e59f","Type":"ContainerStarted","Data":"92e98afaca36715a0b3bdd3d53f625c084c1b92edb46f577632529183d12dcc8"} Jun 10 12:03:28.906559 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.906534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frbbv" event={"ID":"418ef8f8-d194-480d-a185-f6588cbe2296","Type":"ContainerStarted","Data":"c877c7f8f6fb42b79ad9cb8547ca487411f973fe74a9122062b9f9b4ea6f0815"} Jun 10 12:03:28.907431 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.907412 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktjnt" event={"ID":"850947fe-3e58-4508-b491-405a5225641b","Type":"ContainerStarted","Data":"bd4df43ac3194d8d01af531eff857453e58b538ce4a5fad1ffb2414294654880"} Jun 10 12:03:28.909147 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.909119 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" event={"ID":"1c4192ae489bc32c73b2d3c76f561d8f","Type":"ContainerStarted","Data":"eaefc8cc87619d9e03a43002563f163646a187d0436ed83a428068b04551a1e0"} Jun 10 12:03:28.910348 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.910329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerStarted","Data":"80b672e49d3831c3ad6b178a268af60134922a7aff2377a0f30491705a35ca73"} Jun 10 12:03:28.911336 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.911307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88n7p" event={"ID":"13efa946-6bbc-41c2-9204-5c03dba07e39","Type":"ContainerStarted","Data":"4af68c2bd1ffdd487c3e257c45fd8c6d7695aa0dde8178437e48999b125168a5"} Jun 10 12:03:28.912342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.912320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zjdl4" event={"ID":"ae6c156d-7315-4279-9950-ff2e9b42da0b","Type":"ContainerStarted","Data":"067f912e9c47eef5793051313cf1df01b85178201dfe9d67302c79d9f84a6a93"} Jun 10 12:03:28.912703 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.912683 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:58:27 +0000 UTC" deadline="2028-01-27 16:11:01.320339564 +0000 UTC" Jun 10 12:03:28.912760 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.912703 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14308h7m32.407639925s" Jun 10 12:03:28.913424 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.913393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" event={"ID":"9589b3eb-7a7a-4721-b42a-77096aa5da58","Type":"ContainerStarted","Data":"4ead78097b85122652c404f05be97fac8f0ebfad73a3298f9f756255acba53a5"} Jun 10 12:03:28.914402 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.914349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"dec2037482bfc46150aae4e36a9cc9920d0bbdcb9c210c976f30078c50e9c71f"} Jun 10 12:03:28.927963 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:28.926865 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-32.ec2.internal" podStartSLOduration=1.926849613 podStartE2EDuration="1.926849613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:28.926179183 +0000 UTC m=+3.514526042" watchObservedRunningTime="2026-06-10 12:03:28.926849613 +0000 UTC m=+3.515196473" Jun 10 12:03:29.554455 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.554421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:29.554593 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.554468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:29.554678 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.554602 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:29.554729 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.554677 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:31.554657172 +0000 UTC m=+6.143004029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:29.555109 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.555089 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:29.555201 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.555149 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:31.555132614 +0000 UTC m=+6.143479453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:29.655959 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.655756 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:29.656592 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.656165 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:29.656592 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.656188 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:29.656592 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.656201 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:29.656592 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.656263 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:31.656244654 +0000 UTC m=+6.244591494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:29.895563 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.895487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:29.895982 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.895606 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:29.896070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.896001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:29.896119 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:29.896094 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:29.913628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.913566 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:58:27 +0000 UTC" deadline="2028-03-07 00:13:35.653831502 +0000 UTC" Jun 10 12:03:29.913628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.913615 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15252h10m5.740220408s" Jun 10 12:03:29.941008 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.939890 2576 generic.go:356] "Generic (PLEG): container finished" podID="2a160c4236c93af34a314177143b85dc" containerID="9cfd8bed1dd4900596b741bc02dbc53143abe25ab7a3ec005a5efe8b4f073198" exitCode=0 Jun 10 12:03:29.941008 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:29.940778 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" event={"ID":"2a160c4236c93af34a314177143b85dc","Type":"ContainerDied","Data":"9cfd8bed1dd4900596b741bc02dbc53143abe25ab7a3ec005a5efe8b4f073198"} Jun 10 12:03:30.894119 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:30.894092 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:30.894309 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:30.894226 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:30.952892 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:30.952238 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" event={"ID":"2a160c4236c93af34a314177143b85dc","Type":"ContainerStarted","Data":"84be6d1c96b5163b9d57f93551531aa862aba53b17880f23d134f55398a2d3c8"} Jun 10 12:03:31.570772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:31.570733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:31.570990 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:31.570786 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:31.570990 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.570957 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:31.570990 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.570958 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:31.571157 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.571017 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:35.570999114 +0000 UTC m=+10.159345955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:31.571157 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.571034 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:35.571025526 +0000 UTC m=+10.159372369 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:31.672591 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:31.672002 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:31.672591 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.672174 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:31.672591 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.672192 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:31.672591 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.672209 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:31.672591 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.672267 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:35.672247166 +0000 UTC m=+10.260594020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:31.893985 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:31.893890 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:31.894135 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.894033 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:31.894273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:31.894251 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:31.894482 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:31.894452 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:32.894410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:32.894320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:32.894863 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:32.894462 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:33.893710 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:33.893484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:33.893710 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:33.893609 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:33.894218 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:33.894079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:33.894218 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:33.894181 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:34.893847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:34.893742 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:34.894308 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:34.893879 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:35.606201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:35.606163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:35.606378 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:35.606213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:35.606378 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.606372 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:35.606477 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.606433 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:43.606412788 +0000 UTC m=+18.194759631 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:35.606477 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.606374 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:35.606581 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.606505 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:43.606486268 +0000 UTC m=+18.194833118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:35.706949 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:35.706906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:35.707161 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.707144 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:35.707235 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.707187 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:35.707235 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.707201 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:35.707344 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.707258 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:43.707236884 +0000 UTC m=+18.295583734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:35.895232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:35.895163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:35.895232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:35.895204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:35.895695 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.895279 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:35.898257 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:35.895991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:36.894229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:36.894105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:36.894386 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:36.894252 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:37.894375 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:37.894277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:37.894375 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:37.894317 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:37.894862 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:37.894408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:37.894862 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:37.894840 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:38.893706 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:38.893632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:38.893844 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:38.893767 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:39.893722 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:39.893685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:39.894277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:39.893692 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:39.894277 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:39.893818 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:39.894277 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:39.893926 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:40.893869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:40.893839 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:40.894265 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:40.893951 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:41.893992 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:41.893957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:41.894411 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:41.893957 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:41.894411 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:41.894070 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:41.894411 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:41.894151 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:42.893756 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:42.893679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:42.893959 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:42.893825 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:43.669715 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:43.669681 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:43.669715 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:43.669718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:43.670221 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.669815 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:43.670221 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.669824 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:43.670221 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.669878 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:59.669859157 +0000 UTC m=+34.258206016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:43.670221 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.669893 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:59.669886666 +0000 UTC m=+34.258233503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:43.770834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:43.770796 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:43.771035 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.770975 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:43.771035 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.770994 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:43.771035 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.771004 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:43.771189 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.771060 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:03:59.771041375 +0000 UTC m=+34.359388225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:43.894344 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:43.894242 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:43.894344 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:43.894293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:43.894570 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.894383 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:43.894570 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:43.894531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:44.893641 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:44.893603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:44.894109 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:44.893743 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:45.894141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:45.894093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:45.894141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:45.894135 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:45.894621 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:45.894215 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:45.894621 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:45.894373 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:46.893308 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:46.893217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:46.893359 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:46.893313 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:47.894008 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.893676 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:47.894990 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.893717 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:47.894990 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:47.894085 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:47.894990 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:47.894148 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:47.986259 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.986230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-frbbv" event={"ID":"418ef8f8-d194-480d-a185-f6588cbe2296","Type":"ContainerStarted","Data":"2547abcbdfab262a122649bac178ad30312a2eaf27e53532a9aaf834e0834968"} Jun 10 12:03:47.987578 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.987550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ktjnt" event={"ID":"850947fe-3e58-4508-b491-405a5225641b","Type":"ContainerStarted","Data":"b59f9a54f88caee0390b39f3e02d04ab0fc98499849bc03c852dd9e403bcb003"} Jun 10 12:03:47.988960 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.988925 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="3d0eba8d8c584cd857ab98598fb2b3c53b5c1aae1d80ee8f86d38890199b33e9" exitCode=0 Jun 10 12:03:47.989056 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.989017 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"3d0eba8d8c584cd857ab98598fb2b3c53b5c1aae1d80ee8f86d38890199b33e9"} Jun 10 12:03:47.990454 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.990433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zjdl4" event={"ID":"ae6c156d-7315-4279-9950-ff2e9b42da0b","Type":"ContainerStarted","Data":"a1aadd9b759dc149fda9f48ecc700cb1361ed4f319e431451e027724a6fe94ae"} Jun 10 12:03:47.991862 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.991843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" event={"ID":"9589b3eb-7a7a-4721-b42a-77096aa5da58","Type":"ContainerStarted","Data":"eca33044e67737ba34d427ee8e0447a936ee52ee3d4f0262fbcfa8b921a4146b"} Jun 10 12:03:47.994360 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994344 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:03:47.994671 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994653 2576 generic.go:356] "Generic (PLEG): container finished" podID="b3cba19f-bf89-44d0-9369-fcf7e2ae5a45" containerID="1bd84b3a299d3e3d7a23a1d56b0b9a5d6cc6a80ccf9bf7093a75b587edb0dea1" exitCode=1 Jun 10 12:03:47.994741 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"206d6d5ce7c0e9285afc92f38952a5cdabc8571bdedcc2c52068b009f947afbd"} Jun 10 12:03:47.994784 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994775 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"a09d25a437bbdd7d92834445fcd9f08e0db8bb09adfc93fbde8e6dc403caf360"} Jun 10 12:03:47.994832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994816 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"50ef2356d68504d482ad1c043b59917e04a43faeb720488d8c114aa000d59d82"} Jun 10 12:03:47.994877 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994846 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"dca92837e08ec5eae3f51fda06d79ed06449cb91463e4d143ffe5b2fbd6a56c6"} Jun 10 12:03:47.994923 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994876 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerDied","Data":"1bd84b3a299d3e3d7a23a1d56b0b9a5d6cc6a80ccf9bf7093a75b587edb0dea1"} Jun 10 12:03:47.994923 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.994913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"fb3700794c1a8442ac06954bef97cdcd46079548d21f9091613a848d0d12ea37"} Jun 10 12:03:47.995958 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.995923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-w4vtv" event={"ID":"059ab479-e5ad-48e1-af81-bb11ea2d77cd","Type":"ContainerStarted","Data":"99b41df32d780d6af2a7b07f45163f0271250cc2baf5f18a348f9a565cceffdb"} Jun 10 12:03:47.997107 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:47.997088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5p87" event={"ID":"8be82b18-301f-4fdc-b41c-49295824e59f","Type":"ContainerStarted","Data":"b1a154efea8b22767804f4e4aea713775a9335fd09018f7e2338c8ca0d2b808b"} Jun 10 12:03:48.006795 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.006751 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-32.ec2.internal" podStartSLOduration=21.006738502 podStartE2EDuration="21.006738502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:30.969220183 +0000 UTC m=+5.557567042" watchObservedRunningTime="2026-06-10 12:03:48.006738502 +0000 UTC m=+22.595085360" Jun 10 12:03:48.024355 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.024313 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-k5p87" podStartSLOduration=7.823465378 podStartE2EDuration="22.024300737s" totalImagesPullingTime="14.200835359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.024291887 +0000 UTC m=+22.612638758" watchObservedRunningTime="2026-06-10 12:03:48.024300737 +0000 UTC m=+22.612647575" Jun 10 12:03:48.024848 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.024827 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-frbbv" podStartSLOduration=3.584799087 podStartE2EDuration="22.024821858s" totalImagesPullingTime="18.440022771s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.006106697 +0000 UTC m=+22.594453558" watchObservedRunningTime="2026-06-10 12:03:48.024821858 +0000 UTC m=+22.613168764" Jun 10 12:03:48.075194 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.075156 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zjdl4" podStartSLOduration=3.639833942 podStartE2EDuration="22.07514343s" totalImagesPullingTime="18.435309488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.074783451 +0000 UTC m=+22.663130308" watchObservedRunningTime="2026-06-10 12:03:48.07514343 +0000 UTC m=+22.663490288" Jun 10 12:03:48.095258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.095223 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ktjnt" podStartSLOduration=4.608356066 podStartE2EDuration="23.09521135s" totalImagesPullingTime="18.486855284s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.094811733 +0000 UTC m=+22.683158590" watchObservedRunningTime="2026-06-10 12:03:48.09521135 +0000 UTC m=+22.683558208" Jun 10 12:03:48.289281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.289251 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 12:03:48.885440 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.885327 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T12:03:48.289267955Z","UUID":"e4eff4ee-e72e-475c-98cd-f7903b16e5bb","Handler":null,"Name":"","Endpoint":""} Jun 10 12:03:48.887006 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.886974 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 12:03:48.887150 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.887022 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 12:03:48.893324 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:48.893303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:48.893472 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:48.893443 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:49.001682 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.001648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-88n7p" event={"ID":"13efa946-6bbc-41c2-9204-5c03dba07e39","Type":"ContainerStarted","Data":"9ebfd351e39cc5298165baed99305928968e70a2fcfcf4aa479dc2f042bf658c"} Jun 10 12:03:49.003835 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.003799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" event={"ID":"9589b3eb-7a7a-4721-b42a-77096aa5da58","Type":"ContainerStarted","Data":"dd0333b3309d50504ec8dedb6451568964c92fd8b188651aa9a2545f1058da12"} Jun 10 12:03:49.017771 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.017725 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-w4vtv" podStartSLOduration=9.818144596 podStartE2EDuration="24.017707585s" totalImagesPullingTime="14.199562989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.115798077 +0000 UTC m=+22.704144935" watchObservedRunningTime="2026-06-10 12:03:49.017707585 +0000 UTC m=+23.606054446" Jun 10 12:03:49.018242 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.018207 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-88n7p" podStartSLOduration=4.585489722 podStartE2EDuration="23.01819853s" totalImagesPullingTime="18.432708808s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:49.017667351 +0000 UTC m=+23.606014210" watchObservedRunningTime="2026-06-10 12:03:49.01819853 +0000 UTC m=+23.606545415" Jun 10 12:03:49.894077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.893801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:49.894234 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:49.893877 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:49.894234 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:49.894131 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:49.894234 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:49.894212 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:50.009653 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.009625 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:03:50.010144 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.010034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"f83e1e75f0035b5deaeea43f1a5a2a42bc9ff0811513f4d436c0b0f433da9db4"} Jun 10 12:03:50.012220 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.012192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" event={"ID":"9589b3eb-7a7a-4721-b42a-77096aa5da58","Type":"ContainerStarted","Data":"ebc5a932148d067560c1baf6b214d94fc7374a9418e1d33f5c7b23c85dbfc60f"} Jun 10 12:03:50.030044 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.029991 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8xtzb" podStartSLOduration=3.636386281 podStartE2EDuration="24.029975s" totalImagesPullingTime="20.393588719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:50.028566708 +0000 UTC m=+24.616913571" watchObservedRunningTime="2026-06-10 12:03:50.029975 +0000 UTC m=+24.618321861" Jun 10 12:03:50.662587 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.662557 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:50.663171 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.663152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:50.893636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:50.893609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:50.893795 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:50.893716 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:51.894077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:51.894042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:51.894795 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:51.894042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:51.894795 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:51.894174 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:51.894795 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:51.894235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:52.020843 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.020778 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:03:52.021246 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.021163 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"a7abc499f67651cecb8c4a59cf449b993e7aa7b0667cc3ea1cf66ba39754e920"} Jun 10 12:03:52.021501 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.021442 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:52.021711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.021525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:52.021711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.021576 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:52.021711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.021671 2576 scope.go:117] "RemoveContainer" containerID="1bd84b3a299d3e3d7a23a1d56b0b9a5d6cc6a80ccf9bf7093a75b587edb0dea1" Jun 10 12:03:52.039560 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.039451 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:52.040140 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.039883 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:03:52.097345 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.096570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:52.097345 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.096869 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 12:03:52.097609 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.097560 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-w4vtv" Jun 10 12:03:52.893593 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:52.893565 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:52.893728 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:52.893665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:53.026854 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.026829 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:03:53.027290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.027192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" event={"ID":"b3cba19f-bf89-44d0-9369-fcf7e2ae5a45","Type":"ContainerStarted","Data":"4f82703cc73d0f0c0b2b25b10e56dcdea8a347afed795c8dbc50704c385fad49"} Jun 10 12:03:53.028772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.028747 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="4a7a96412ef6f10906ff401014e639233892226f4e3c74fce0baaa6772ed5c89" exitCode=0 Jun 10 12:03:53.028877 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.028807 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"4a7a96412ef6f10906ff401014e639233892226f4e3c74fce0baaa6772ed5c89"} Jun 10 12:03:53.056698 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.056644 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" podStartSLOduration=8.597663113 podStartE2EDuration="27.056630129s" totalImagesPullingTime="18.458967016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:53.056599146 +0000 UTC m=+27.644946005" watchObservedRunningTime="2026-06-10 12:03:53.056630129 +0000 UTC m=+27.644977003" Jun 10 12:03:53.893852 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.893825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:53.894030 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:53.893920 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:53.894030 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.893960 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:53.894115 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:53.894049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:53.930502 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.930458 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qf9vf"] Jun 10 12:03:53.930981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.930955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsd5d"] Jun 10 12:03:53.933460 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.933434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mgf74"] Jun 10 12:03:53.933564 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:53.933551 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:53.933694 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:53.933672 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:54.031297 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:54.031241 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:54.031647 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:54.031248 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:54.031647 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:54.031334 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:54.031647 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:54.031401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:55.035542 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:55.035359 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="0af945f418e3f6b2f66241cb3d0471dbcbf8edef292a9422c1e97a40a0933bfa" exitCode=0 Jun 10 12:03:55.035987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:55.035441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"0af945f418e3f6b2f66241cb3d0471dbcbf8edef292a9422c1e97a40a0933bfa"} Jun 10 12:03:55.894910 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:55.894888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:55.895042 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:55.894991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:55.895104 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:55.895073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:55.895213 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:55.895189 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:55.895281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:55.895240 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:55.895335 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:55.895310 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:57.041828 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:57.041792 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="443b76ace0ca9eb6bd42b5d8bea0a353b7db01b4ac31399cc68c83a491bfa81d" exitCode=0 Jun 10 12:03:57.042476 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:57.041840 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"443b76ace0ca9eb6bd42b5d8bea0a353b7db01b4ac31399cc68c83a491bfa81d"} Jun 10 12:03:57.893944 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:57.893892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:57.894127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:57.893892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:57.894127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:57.893892 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:57.894127 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:57.894048 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:57.894299 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:57.894205 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:57.894356 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:57.894307 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:03:59.695885 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.695848 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:59.695885 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.695886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:59.696478 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.696023 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:59.696478 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.696087 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:31.696071655 +0000 UTC m=+66.284418493 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:59.696478 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.696024 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:59.696478 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.696162 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret podName:e2c1011e-ad04-4614-a3d5-08e7ee8170d0 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:31.69614398 +0000 UTC m=+66.284490836 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret") pod "global-pull-secret-syncer-qsd5d" (UID: "e2c1011e-ad04-4614-a3d5-08e7ee8170d0") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:59.796339 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.796303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:59.796504 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.796472 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:59.796504 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.796498 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:59.796593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.796509 2576 projected.go:196] Error preparing data for projected volume kube-api-access-p7pgp for pod openshift-network-diagnostics/network-check-target-qf9vf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:59.796593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.796561 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp podName:faefc69a-08f1-4f25-826f-1de34ddc056d nodeName:}" failed. No retries permitted until 2026-06-10 12:04:31.796547711 +0000 UTC m=+66.384894550 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p7pgp" (UniqueName: "kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp") pod "network-check-target-qf9vf" (UID: "faefc69a-08f1-4f25-826f-1de34ddc056d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:59.893917 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.893885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:03:59.894109 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.893885 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:03:59.894172 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.894023 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qf9vf" podUID="faefc69a-08f1-4f25-826f-1de34ddc056d" Jun 10 12:03:59.894172 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:03:59.894151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:03:59.894266 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.894146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:03:59.894266 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:03:59.894249 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qsd5d" podUID="e2c1011e-ad04-4614-a3d5-08e7ee8170d0" Jun 10 12:04:00.785114 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.785038 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-32.ec2.internal" event="NodeReady" Jun 10 12:04:00.785546 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.785195 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 12:04:00.826438 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.826409 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wn6xg"] Jun 10 12:04:00.857950 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.857911 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-gq6mr"] Jun 10 12:04:00.858137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.858060 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:00.861058 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.861032 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 12:04:00.861189 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.861055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 12:04:00.861189 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.861085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xc76w\"" Jun 10 12:04:00.871879 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.871857 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wn6xg"] Jun 10 12:04:00.872021 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.871901 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gq6mr"] Jun 10 12:04:00.872083 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.872017 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:00.875054 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.875034 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 12:04:00.875659 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.875638 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kwnl9\"" Jun 10 12:04:00.875759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.875640 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 12:04:00.875759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:00.875672 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 12:04:01.005011 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.004975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef18a3cb-ef28-4e84-83f3-77ca605680c1-tmp-dir\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.005011 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.005023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.005257 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.005096 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef18a3cb-ef28-4e84-83f3-77ca605680c1-config-volume\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.005257 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.005187 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-cert\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.005257 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.005215 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vwv5\" (UniqueName: \"kubernetes.io/projected/ef18a3cb-ef28-4e84-83f3-77ca605680c1-kube-api-access-7vwv5\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.005257 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.005251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdh2v\" (UniqueName: \"kubernetes.io/projected/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-kube-api-access-xdh2v\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.106569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef18a3cb-ef28-4e84-83f3-77ca605680c1-tmp-dir\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.106569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106532 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.106569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106561 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef18a3cb-ef28-4e84-83f3-77ca605680c1-config-volume\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.106820 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106587 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-cert\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.106820 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vwv5\" (UniqueName: \"kubernetes.io/projected/ef18a3cb-ef28-4e84-83f3-77ca605680c1-kube-api-access-7vwv5\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.106820 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106622 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdh2v\" (UniqueName: \"kubernetes.io/projected/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-kube-api-access-xdh2v\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.106820 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:01.106662 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:01.106820 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:01.106728 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:01.606712834 +0000 UTC m=+36.195059676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:01.107063 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.106854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ef18a3cb-ef28-4e84-83f3-77ca605680c1-tmp-dir\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.107163 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.107146 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ef18a3cb-ef28-4e84-83f3-77ca605680c1-config-volume\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.110980 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.110958 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-cert\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.119734 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.119709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdh2v\" (UniqueName: \"kubernetes.io/projected/60f1beb1-dc58-45f0-8efb-8d879a73cd8e-kube-api-access-xdh2v\") pod \"ingress-canary-gq6mr\" (UID: \"60f1beb1-dc58-45f0-8efb-8d879a73cd8e\") " pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.119734 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.119728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vwv5\" (UniqueName: \"kubernetes.io/projected/ef18a3cb-ef28-4e84-83f3-77ca605680c1-kube-api-access-7vwv5\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.181771 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.181746 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-gq6mr" Jun 10 12:04:01.349517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.349382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-gq6mr"] Jun 10 12:04:01.352568 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:04:01.352539 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60f1beb1_dc58_45f0_8efb_8d879a73cd8e.slice/crio-b6aa32f4655bdc995588ead0c74f4c0869c1bb0eba3d8aa0c310cf223957978e WatchSource:0}: Error finding container b6aa32f4655bdc995588ead0c74f4c0869c1bb0eba3d8aa0c310cf223957978e: Status 404 returned error can't find the container with id b6aa32f4655bdc995588ead0c74f4c0869c1bb0eba3d8aa0c310cf223957978e Jun 10 12:04:01.611153 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.611076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:01.611280 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:01.611184 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:01.611280 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:01.611241 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:02.611227049 +0000 UTC m=+37.199573886 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:01.893571 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.893468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:04:01.893571 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.893468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:04:01.894061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.893468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:04:01.897096 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.896684 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xl6cp\"" Jun 10 12:04:01.897096 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.896925 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:04:01.898029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.897950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:04:01.898029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.898004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:04:01.898218 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.898089 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjlvn\"" Jun 10 12:04:01.898218 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:01.898115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:04:02.054269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:02.054231 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gq6mr" event={"ID":"60f1beb1-dc58-45f0-8efb-8d879a73cd8e","Type":"ContainerStarted","Data":"b6aa32f4655bdc995588ead0c74f4c0869c1bb0eba3d8aa0c310cf223957978e"} Jun 10 12:04:02.057560 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:02.057528 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="925d76ec8a65546718a26c820fe55898debf3fc70c380f04ae715e5a3177748b" exitCode=0 Jun 10 12:04:02.057679 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:02.057581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"925d76ec8a65546718a26c820fe55898debf3fc70c380f04ae715e5a3177748b"} Jun 10 12:04:02.617897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:02.617678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:02.618086 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:02.617847 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:02.618086 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:02.618030 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:04.618008712 +0000 UTC m=+39.206355565 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:03.061381 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:03.061348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-gq6mr" event={"ID":"60f1beb1-dc58-45f0-8efb-8d879a73cd8e","Type":"ContainerStarted","Data":"1c00a7da24fcb86a8b93431b84ee1740219376cd7232eabdab8ddeceec600404"} Jun 10 12:04:03.064534 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:03.064512 2576 generic.go:356] "Generic (PLEG): container finished" podID="f7b585af-6f0e-4829-817d-1de83e444980" containerID="d2abae404ed3a298db8f67aa10f6300a0296e4fcf47e71601662aa5be0311800" exitCode=0 Jun 10 12:04:03.064624 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:03.064556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerDied","Data":"d2abae404ed3a298db8f67aa10f6300a0296e4fcf47e71601662aa5be0311800"} Jun 10 12:04:03.075950 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:03.075883 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-gq6mr" podStartSLOduration=1.44182355 podStartE2EDuration="3.075862824s" totalImagesPullingTime="1.634039274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:03.075391308 +0000 UTC m=+37.663738168" watchObservedRunningTime="2026-06-10 12:04:03.075862824 +0000 UTC m=+37.664209685" Jun 10 12:04:04.069948 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:04.069908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" event={"ID":"f7b585af-6f0e-4829-817d-1de83e444980","Type":"ContainerStarted","Data":"dbf5ede492d7c5d2659e2080f3a3db53ec8ec5c0b996b5622cbd27a555f5ee1c"} Jun 10 12:04:04.095476 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:04.095431 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-f9j8k" podStartSLOduration=9.282235848 podStartE2EDuration="38.095417662s" totalImagesPullingTime="28.813181814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:04.093745169 +0000 UTC m=+38.682092029" watchObservedRunningTime="2026-06-10 12:04:04.095417662 +0000 UTC m=+38.683764521" Jun 10 12:04:04.631861 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:04.631810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:04.632072 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:04.631967 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:04.632072 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:04.632035 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:08.632019376 +0000 UTC m=+43.220366217 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:08.657757 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:08.657711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:08.658268 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:08.657963 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:08.658268 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:08.658052 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:16.658027897 +0000 UTC m=+51.246374755 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:16.710303 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:16.710264 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:16.710831 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:16.710417 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:16.710831 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:16.710495 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:32.710478956 +0000 UTC m=+67.298825794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:24.046077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:24.046046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fxflh" Jun 10 12:04:31.716813 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.716773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:04:31.716813 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.716810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:04:31.719631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.719613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:04:31.719685 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.719628 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:04:31.727817 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:31.727795 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:04:31.727883 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:31.727871 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:05:35.727850889 +0000 UTC m=+130.316197726 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : secret "metrics-daemon-secret" not found Jun 10 12:04:31.731348 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.731318 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e2c1011e-ad04-4614-a3d5-08e7ee8170d0-original-pull-secret\") pod \"global-pull-secret-syncer-qsd5d\" (UID: \"e2c1011e-ad04-4614-a3d5-08e7ee8170d0\") " pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:04:31.817755 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.817707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:04:31.820591 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.820572 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:04:31.831090 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.831069 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:04:31.841536 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.841509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7pgp\" (UniqueName: \"kubernetes.io/projected/faefc69a-08f1-4f25-826f-1de34ddc056d-kube-api-access-p7pgp\") pod \"network-check-target-qf9vf\" (UID: \"faefc69a-08f1-4f25-826f-1de34ddc056d\") " pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:04:31.908221 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.908192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xl6cp\"" Jun 10 12:04:31.911717 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.911696 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qsd5d" Jun 10 12:04:31.915620 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:31.915604 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:04:32.053847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:32.050282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qsd5d"] Jun 10 12:04:32.070920 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:32.070895 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qf9vf"] Jun 10 12:04:32.073688 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:04:32.073662 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaefc69a_08f1_4f25_826f_1de34ddc056d.slice/crio-6a0954475d30138673f3ecdb834295f8b12c395a97aaea717df6fd662290a731 WatchSource:0}: Error finding container 6a0954475d30138673f3ecdb834295f8b12c395a97aaea717df6fd662290a731: Status 404 returned error can't find the container with id 6a0954475d30138673f3ecdb834295f8b12c395a97aaea717df6fd662290a731 Jun 10 12:04:32.136650 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:32.136615 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qf9vf" event={"ID":"faefc69a-08f1-4f25-826f-1de34ddc056d","Type":"ContainerStarted","Data":"6a0954475d30138673f3ecdb834295f8b12c395a97aaea717df6fd662290a731"} Jun 10 12:04:32.137776 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:32.137732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsd5d" event={"ID":"e2c1011e-ad04-4614-a3d5-08e7ee8170d0","Type":"ContainerStarted","Data":"47eddd9b95f2f6e897c4e84e787eba39352504d9fb6ae46537d699b6135a4789"} Jun 10 12:04:32.724042 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:32.724000 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:04:32.724636 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:32.724173 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:32.724636 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:04:32.724254 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:05:04.724233218 +0000 UTC m=+99.312580060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:04:37.156249 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:37.156212 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qf9vf" event={"ID":"faefc69a-08f1-4f25-826f-1de34ddc056d","Type":"ContainerStarted","Data":"a46a2c4968e68b86817cc2ff1504c9296f2f01b3187797ec03c3792ed46612bb"} Jun 10 12:04:37.156711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:37.156348 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:04:37.157737 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:37.157714 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qsd5d" event={"ID":"e2c1011e-ad04-4614-a3d5-08e7ee8170d0","Type":"ContainerStarted","Data":"23a233bdf9e9e6fb601ddaa6bc3442497d86641c558ad554611ed3c1e3e38667"} Jun 10 12:04:37.171713 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:37.171665 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qf9vf" podStartSLOduration=66.81314843 podStartE2EDuration="1m11.171650604s" totalImagesPullingTime="4.358502174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:37.171171594 +0000 UTC m=+71.759518467" watchObservedRunningTime="2026-06-10 12:04:37.171650604 +0000 UTC m=+71.759997457" Jun 10 12:04:37.184672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:04:37.184596 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qsd5d" podStartSLOduration=66.803215227 podStartE2EDuration="1m11.184577522s" totalImagesPullingTime="4.381362295s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:37.184031969 +0000 UTC m=+71.772378829" watchObservedRunningTime="2026-06-10 12:04:37.184577522 +0000 UTC m=+71.772924384" Jun 10 12:05:04.742189 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:05:04.742132 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:05:04.742767 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:05:04.742325 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:05:04.742767 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:05:04.742431 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:08.742408636 +0000 UTC m=+163.330755473 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:05:08.163301 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:05:08.163275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qf9vf" Jun 10 12:05:35.751340 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:05:35.751303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:05:35.751912 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:05:35.751487 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:05:35.751912 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:05:35.751582 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs podName:f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10 nodeName:}" failed. No retries permitted until 2026-06-10 12:07:37.751559381 +0000 UTC m=+252.339906237 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs") pod "network-metrics-daemon-mgf74" (UID: "f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10") : secret "metrics-daemon-secret" not found Jun 10 12:06:03.870257 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:03.870163 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wn6xg" podUID="ef18a3cb-ef28-4e84-83f3-77ca605680c1" Jun 10 12:06:04.364162 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:04.364134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:06:04.918459 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:04.918424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-mgf74" podUID="f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10" Jun 10 12:06:08.774974 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:08.774878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:06:08.775368 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:08.775011 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:06:08.775368 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:08.775067 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls podName:ef18a3cb-ef28-4e84-83f3-77ca605680c1 nodeName:}" failed. No retries permitted until 2026-06-10 12:08:10.775053806 +0000 UTC m=+285.363400643 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls") pod "dns-default-wn6xg" (UID: "ef18a3cb-ef28-4e84-83f3-77ca605680c1") : secret "dns-default-metrics-tls" not found Jun 10 12:06:13.237081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.237044 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jprdj"] Jun 10 12:06:13.238941 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.238916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.242205 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.242185 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 10 12:06:13.242323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.242266 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 10 12:06:13.243291 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.243270 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.243391 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.243323 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pkmql\"" Jun 10 12:06:13.243391 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.243349 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.246184 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.246165 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:06:13.247860 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.247843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 10 12:06:13.248255 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.248240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm"] Jun 10 12:06:13.248359 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.248346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.250117 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.250102 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.250995 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.250975 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 10 12:06:13.251067 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.251005 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nxsql\"" Jun 10 12:06:13.251428 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.251406 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 10 12:06:13.251819 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.251802 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 10 12:06:13.254571 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.254462 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 10 12:06:13.254571 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.254519 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 10 12:06:13.255243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.255222 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qswhm\"" Jun 10 12:06:13.255366 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.255348 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.255431 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.255368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.257050 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.257023 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jprdj"] Jun 10 12:06:13.258124 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.258104 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 10 12:06:13.259755 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.259737 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm"] Jun 10 12:06:13.262757 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.262725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:06:13.330702 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.330661 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8"] Jun 10 12:06:13.332654 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.332561 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" Jun 10 12:06:13.333838 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.333814 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46"] Jun 10 12:06:13.335029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.335012 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8d99f\"" Jun 10 12:06:13.335494 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.335481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" Jun 10 12:06:13.337705 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.337683 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-jpgbr"] Jun 10 12:06:13.338638 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.338535 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kxfvj\"" Jun 10 12:06:13.339578 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.339555 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.339806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.339789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.340735 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.340715 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.343209 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.343190 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 10 12:06:13.344192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.344029 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 10 12:06:13.344192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.344044 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8"] Jun 10 12:06:13.344192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.344144 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-wtjxm\"" Jun 10 12:06:13.344192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.344184 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.344192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.344190 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.347888 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.347864 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46"] Jun 10 12:06:13.349412 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.349394 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 10 12:06:13.352704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.352664 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-jpgbr"] Jun 10 12:06:13.404696 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404663 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-config\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.404696 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404696 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac11464-3642-44c1-a3b3-f5313da89b24-serving-cert\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.404890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76ff5d25-7211-448b-81d5-b9d082c6d06d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404901 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-trusted-ca\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.404923 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.405017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.405033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.405050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz8l5\" (UniqueName: \"kubernetes.io/projected/4ac11464-3642-44c1-a3b3-f5313da89b24-kube-api-access-gz8l5\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.405064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpxcv\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.405142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.405079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lvrr\" (UniqueName: \"kubernetes.io/projected/76ff5d25-7211-448b-81d5-b9d082c6d06d-kube-api-access-5lvrr\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.506134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506043 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-service-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.506134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-serving-cert\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.506134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76ff5d25-7211-448b-81d5-b9d082c6d06d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.506374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-trusted-ca\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.506374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-snapshots\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.506574 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506537 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-trusted-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.506627 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz8l5\" (UniqueName: \"kubernetes.io/projected/4ac11464-3642-44c1-a3b3-f5313da89b24-kube-api-access-gz8l5\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.506627 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpxcv\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506724 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-config\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.506724 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506724 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac11464-3642-44c1-a3b3-f5313da89b24-serving-cert\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.506869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-tmp\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.506869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m228q\" (UniqueName: \"kubernetes.io/projected/b0959c35-9985-4189-a702-46c2b4e313d4-kube-api-access-m228q\") pod \"network-check-source-dbd9cf844-tghq8\" (UID: \"b0959c35-9985-4189-a702-46c2b4e313d4\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" Jun 10 12:06:13.506869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.506869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506857 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9fqk\" (UniqueName: \"kubernetes.io/projected/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-kube-api-access-c9fqk\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.507128 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.507128 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.506912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lvrr\" (UniqueName: \"kubernetes.io/projected/76ff5d25-7211-448b-81d5-b9d082c6d06d-kube-api-access-5lvrr\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.507128 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/76ff5d25-7211-448b-81d5-b9d082c6d06d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.507320 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:13.507301 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:06:13.507380 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:13.507324 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c98dcbd9f-76d24: secret "image-registry-tls" not found Jun 10 12:06:13.507380 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-trusted-ca\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.507477 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507397 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.507477 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:13.507415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls podName:9f8402ae-d84d-4f93-9bec-f087ae12d150 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.007395753 +0000 UTC m=+168.595742609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls") pod "image-registry-5c98dcbd9f-76d24" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150") : secret "image-registry-tls" not found Jun 10 12:06:13.507477 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507464 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.507690 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.507757 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.507757 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.507737 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpqsn\" (UniqueName: \"kubernetes.io/projected/fbc763c8-9240-4853-92a4-680992054486-kube-api-access-cpqsn\") pod \"volume-data-source-validator-78dd696465-8rn46\" (UID: \"fbc763c8-9240-4853-92a4-680992054486\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" Jun 10 12:06:13.507868 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:13.507800 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:13.507868 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:13.507856 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.007840387 +0000 UTC m=+168.596187231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:13.508024 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.508005 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4ac11464-3642-44c1-a3b3-f5313da89b24-config\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.509125 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.509100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.509210 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.509145 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.509314 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.509295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4ac11464-3642-44c1-a3b3-f5313da89b24-serving-cert\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.516779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.516755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.517085 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.517058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpxcv\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:13.517399 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.517379 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz8l5\" (UniqueName: \"kubernetes.io/projected/4ac11464-3642-44c1-a3b3-f5313da89b24-kube-api-access-gz8l5\") pod \"console-operator-668fdbf85c-jprdj\" (UID: \"4ac11464-3642-44c1-a3b3-f5313da89b24\") " pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.517446 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.517399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lvrr\" (UniqueName: \"kubernetes.io/projected/76ff5d25-7211-448b-81d5-b9d082c6d06d-kube-api-access-5lvrr\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:13.548422 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.548387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:13.609348 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpqsn\" (UniqueName: \"kubernetes.io/projected/fbc763c8-9240-4853-92a4-680992054486-kube-api-access-cpqsn\") pod \"volume-data-source-validator-78dd696465-8rn46\" (UID: \"fbc763c8-9240-4853-92a4-680992054486\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" Jun 10 12:06:13.609512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609365 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-service-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.609512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-serving-cert\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.609512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-snapshots\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.609512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-trusted-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.609700 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-tmp\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.609700 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609563 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m228q\" (UniqueName: \"kubernetes.io/projected/b0959c35-9985-4189-a702-46c2b4e313d4-kube-api-access-m228q\") pod \"network-check-source-dbd9cf844-tghq8\" (UID: \"b0959c35-9985-4189-a702-46c2b4e313d4\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" Jun 10 12:06:13.609700 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.609596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9fqk\" (UniqueName: \"kubernetes.io/projected/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-kube-api-access-c9fqk\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.610625 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.610330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-service-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.610625 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.610584 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-tmp\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.610790 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.610685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-snapshots\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.610790 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.610773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-trusted-ca-bundle\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.612802 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.612778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-serving-cert\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.617500 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.617462 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpqsn\" (UniqueName: \"kubernetes.io/projected/fbc763c8-9240-4853-92a4-680992054486-kube-api-access-cpqsn\") pod \"volume-data-source-validator-78dd696465-8rn46\" (UID: \"fbc763c8-9240-4853-92a4-680992054486\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" Jun 10 12:06:13.617865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.617847 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9fqk\" (UniqueName: \"kubernetes.io/projected/653dc9bb-b8a7-44cc-9b3f-41dc265169d1-kube-api-access-c9fqk\") pod \"insights-operator-896549976-jpgbr\" (UID: \"653dc9bb-b8a7-44cc-9b3f-41dc265169d1\") " pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.618025 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.618008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m228q\" (UniqueName: \"kubernetes.io/projected/b0959c35-9985-4189-a702-46c2b4e313d4-kube-api-access-m228q\") pod \"network-check-source-dbd9cf844-tghq8\" (UID: \"b0959c35-9985-4189-a702-46c2b4e313d4\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" Jun 10 12:06:13.648254 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.648217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" Jun 10 12:06:13.656046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.656013 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" Jun 10 12:06:13.661058 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.661032 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-jpgbr" Jun 10 12:06:13.674033 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.673996 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-jprdj"] Jun 10 12:06:13.676729 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:13.676703 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac11464_3642_44c1_a3b3_f5313da89b24.slice/crio-b574713d505f355871c45f3ee25b77bf753ed66d20daaa0cfaadb870584c00f4 WatchSource:0}: Error finding container b574713d505f355871c45f3ee25b77bf753ed66d20daaa0cfaadb870584c00f4: Status 404 returned error can't find the container with id b574713d505f355871c45f3ee25b77bf753ed66d20daaa0cfaadb870584c00f4 Jun 10 12:06:13.793462 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:13.793426 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc763c8_9240_4853_92a4_680992054486.slice/crio-48e02fadaf9451049a6357cb956e1e08923d4b7a0d09aaa09bb50df00df3c95c WatchSource:0}: Error finding container 48e02fadaf9451049a6357cb956e1e08923d4b7a0d09aaa09bb50df00df3c95c: Status 404 returned error can't find the container with id 48e02fadaf9451049a6357cb956e1e08923d4b7a0d09aaa09bb50df00df3c95c Jun 10 12:06:13.794403 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.794178 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46"] Jun 10 12:06:13.805805 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.805767 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8"] Jun 10 12:06:13.808620 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:13.808591 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0959c35_9985_4189_a702_46c2b4e313d4.slice/crio-628b44c779342c86818c57d9915dc5db3447205e7f432fbc33c298abf860dc54 WatchSource:0}: Error finding container 628b44c779342c86818c57d9915dc5db3447205e7f432fbc33c298abf860dc54: Status 404 returned error can't find the container with id 628b44c779342c86818c57d9915dc5db3447205e7f432fbc33c298abf860dc54 Jun 10 12:06:13.824996 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:13.824843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-jpgbr"] Jun 10 12:06:13.826965 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:13.826924 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod653dc9bb_b8a7_44cc_9b3f_41dc265169d1.slice/crio-c30bff753c28ff5368f8e16978638c7952d8d5accb9b7188f34c07781ae58ae2 WatchSource:0}: Error finding container c30bff753c28ff5368f8e16978638c7952d8d5accb9b7188f34c07781ae58ae2: Status 404 returned error can't find the container with id c30bff753c28ff5368f8e16978638c7952d8d5accb9b7188f34c07781ae58ae2 Jun 10 12:06:14.013977 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.013924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.013997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:14.014075 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:14.014090 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c98dcbd9f-76d24: secret "image-registry-tls" not found Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:14.014109 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:14.014147 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls podName:9f8402ae-d84d-4f93-9bec-f087ae12d150 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:15.014129598 +0000 UTC m=+169.602476444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls") pod "image-registry-5c98dcbd9f-76d24" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150") : secret "image-registry-tls" not found Jun 10 12:06:14.014171 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:14.014174 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:15.014157385 +0000 UTC m=+169.602504224 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:14.387391 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.387322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" event={"ID":"4ac11464-3642-44c1-a3b3-f5313da89b24","Type":"ContainerStarted","Data":"b574713d505f355871c45f3ee25b77bf753ed66d20daaa0cfaadb870584c00f4"} Jun 10 12:06:14.388699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.388657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" event={"ID":"fbc763c8-9240-4853-92a4-680992054486","Type":"ContainerStarted","Data":"48e02fadaf9451049a6357cb956e1e08923d4b7a0d09aaa09bb50df00df3c95c"} Jun 10 12:06:14.389977 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.389949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jpgbr" event={"ID":"653dc9bb-b8a7-44cc-9b3f-41dc265169d1","Type":"ContainerStarted","Data":"c30bff753c28ff5368f8e16978638c7952d8d5accb9b7188f34c07781ae58ae2"} Jun 10 12:06:14.391961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.391517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" event={"ID":"b0959c35-9985-4189-a702-46c2b4e313d4","Type":"ContainerStarted","Data":"444fb77acc405dc53cd3f72246d560a212c84814dc1f82b26227aab1752d3487"} Jun 10 12:06:14.391961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.391560 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" event={"ID":"b0959c35-9985-4189-a702-46c2b4e313d4","Type":"ContainerStarted","Data":"628b44c779342c86818c57d9915dc5db3447205e7f432fbc33c298abf860dc54"} Jun 10 12:06:14.407262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:14.407213 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-tghq8" podStartSLOduration=1.407197485 podStartE2EDuration="1.407197485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:14.405375105 +0000 UTC m=+168.993721968" watchObservedRunningTime="2026-06-10 12:06:14.407197485 +0000 UTC m=+168.995544336" Jun 10 12:06:15.022912 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:15.022878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:15.023066 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:15.022925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:15.023066 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:15.023039 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:15.023066 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:15.023043 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:06:15.023066 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:15.023062 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c98dcbd9f-76d24: secret "image-registry-tls" not found Jun 10 12:06:15.023239 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:15.023107 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls podName:9f8402ae-d84d-4f93-9bec-f087ae12d150 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.023089008 +0000 UTC m=+171.611435861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls") pod "image-registry-5c98dcbd9f-76d24" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150") : secret "image-registry-tls" not found Jun 10 12:06:15.023239 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:15.023122 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.023114785 +0000 UTC m=+171.611461623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:15.400303 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:15.400261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" event={"ID":"fbc763c8-9240-4853-92a4-680992054486","Type":"ContainerStarted","Data":"0c11aef19d7d12a9acda949063fd5328836262a881d14d6d81651b31236eb7da"} Jun 10 12:06:15.416264 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:15.416210 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-8rn46" podStartSLOduration=1.369447726 podStartE2EDuration="2.41619343s" totalImagesPullingTime="1.046745704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:15.41548602 +0000 UTC m=+170.003832893" watchObservedRunningTime="2026-06-10 12:06:15.41619343 +0000 UTC m=+170.004540282" Jun 10 12:06:17.039183 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.039135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:17.039183 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.039183 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:17.039593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:17.039306 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:17.039593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:17.039334 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:06:17.039593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:17.039358 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.039345203 +0000 UTC m=+175.627692042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:17.039593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:17.039359 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c98dcbd9f-76d24: secret "image-registry-tls" not found Jun 10 12:06:17.039593 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:17.039415 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls podName:9f8402ae-d84d-4f93-9bec-f087ae12d150 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.039397157 +0000 UTC m=+175.627744012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls") pod "image-registry-5c98dcbd9f-76d24" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150") : secret "image-registry-tls" not found Jun 10 12:06:17.408317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.408247 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/0.log" Jun 10 12:06:17.408317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.408288 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ac11464-3642-44c1-a3b3-f5313da89b24" containerID="fd887b6d28fd0251794fc3f2802354dd4208b077ee3bd77cc5d5b5fc8eda8417" exitCode=255 Jun 10 12:06:17.408532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.408381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" event={"ID":"4ac11464-3642-44c1-a3b3-f5313da89b24","Type":"ContainerDied","Data":"fd887b6d28fd0251794fc3f2802354dd4208b077ee3bd77cc5d5b5fc8eda8417"} Jun 10 12:06:17.408605 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.408590 2576 scope.go:117] "RemoveContainer" containerID="fd887b6d28fd0251794fc3f2802354dd4208b077ee3bd77cc5d5b5fc8eda8417" Jun 10 12:06:17.409907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:17.409880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jpgbr" event={"ID":"653dc9bb-b8a7-44cc-9b3f-41dc265169d1","Type":"ContainerStarted","Data":"4cd6e0881a3d12dfaf60c6d651a6ef2cd3b0d1cf01740dcef3e3609f42917121"} Jun 10 12:06:18.417908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.417881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/1.log" Jun 10 12:06:18.418293 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.418274 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/0.log" Jun 10 12:06:18.418338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.418304 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ac11464-3642-44c1-a3b3-f5313da89b24" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" exitCode=255 Jun 10 12:06:18.418384 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.418374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" event={"ID":"4ac11464-3642-44c1-a3b3-f5313da89b24","Type":"ContainerDied","Data":"e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add"} Jun 10 12:06:18.418449 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.418438 2576 scope.go:117] "RemoveContainer" containerID="fd887b6d28fd0251794fc3f2802354dd4208b077ee3bd77cc5d5b5fc8eda8417" Jun 10 12:06:18.418648 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.418629 2576 scope.go:117] "RemoveContainer" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" Jun 10 12:06:18.418822 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:18.418802 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:18.433699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.433657 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-jpgbr" podStartSLOduration=2.715597959 podStartE2EDuration="5.433640071s" totalImagesPullingTime="2.718042112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:17.44171365 +0000 UTC m=+172.030060523" watchObservedRunningTime="2026-06-10 12:06:18.433640071 +0000 UTC m=+173.021986932" Jun 10 12:06:18.893495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:18.893451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:06:19.422629 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.422602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/1.log" Jun 10 12:06:19.423027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.422902 2576 scope.go:117] "RemoveContainer" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" Jun 10 12:06:19.423089 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:19.423071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:19.627410 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.627373 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fp45"] Jun 10 12:06:19.629730 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.629713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.632522 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.632502 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 10 12:06:19.632522 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.632514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-6g4mm\"" Jun 10 12:06:19.632679 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.632573 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 10 12:06:19.632679 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.632614 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 10 12:06:19.632834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.632821 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 10 12:06:19.638229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.638207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fp45"] Jun 10 12:06:19.761052 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.761019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-key\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.761240 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.761064 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rvgj\" (UniqueName: \"kubernetes.io/projected/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-kube-api-access-2rvgj\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.761240 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.761177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-cabundle\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.862409 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.862372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-key\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.862409 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.862410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rvgj\" (UniqueName: \"kubernetes.io/projected/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-kube-api-access-2rvgj\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.862646 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.862459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-cabundle\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.863137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.863118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-cabundle\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.864753 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.864728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-signing-key\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.870779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.870755 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rvgj\" (UniqueName: \"kubernetes.io/projected/83d1d12e-c976-4c49-b83c-1e098b4cd4d0-kube-api-access-2rvgj\") pod \"service-ca-7d74d578b8-2fp45\" (UID: \"83d1d12e-c976-4c49-b83c-1e098b4cd4d0\") " pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:19.938945 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:19.938911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" Jun 10 12:06:20.058832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:20.058805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-2fp45"] Jun 10 12:06:20.062207 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:20.062181 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d1d12e_c976_4c49_b83c_1e098b4cd4d0.slice/crio-aeef0a9c940e3351fd62c4d2f2f8b0f58864b8498fc5fe4eac2f92a6318c49d1 WatchSource:0}: Error finding container aeef0a9c940e3351fd62c4d2f2f8b0f58864b8498fc5fe4eac2f92a6318c49d1: Status 404 returned error can't find the container with id aeef0a9c940e3351fd62c4d2f2f8b0f58864b8498fc5fe4eac2f92a6318c49d1 Jun 10 12:06:20.426444 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:20.426355 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" event={"ID":"83d1d12e-c976-4c49-b83c-1e098b4cd4d0","Type":"ContainerStarted","Data":"aeef0a9c940e3351fd62c4d2f2f8b0f58864b8498fc5fe4eac2f92a6318c49d1"} Jun 10 12:06:20.864884 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:20.864856 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5p87_8be82b18-301f-4fdc-b41c-49295824e59f/dns-node-resolver/0.log" Jun 10 12:06:21.071115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:21.071082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:21.071115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:21.071130 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:21.071336 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:21.071248 2576 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 10 12:06:21.071336 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:21.071277 2576 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5c98dcbd9f-76d24: secret "image-registry-tls" not found Jun 10 12:06:21.071336 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:21.071250 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:21.071483 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:21.071347 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls podName:9f8402ae-d84d-4f93-9bec-f087ae12d150 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.071327698 +0000 UTC m=+183.659674537 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls") pod "image-registry-5c98dcbd9f-76d24" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150") : secret "image-registry-tls" not found Jun 10 12:06:21.071483 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:21.071363 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.071354907 +0000 UTC m=+183.659701746 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:21.864521 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:21.864496 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zjdl4_ae6c156d-7315-4279-9950-ff2e9b42da0b/node-ca/0.log" Jun 10 12:06:22.436314 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:22.436220 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" event={"ID":"83d1d12e-c976-4c49-b83c-1e098b4cd4d0","Type":"ContainerStarted","Data":"786ebaece6fe3ffe9a2e195c943b9fdf81b6210e59e2a5d4d7e73ed0c9ff22f4"} Jun 10 12:06:22.452130 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:22.452081 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-2fp45" podStartSLOduration=1.351549165 podStartE2EDuration="3.45206323s" totalImagesPullingTime="2.100514065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:22.450662181 +0000 UTC m=+177.039009041" watchObservedRunningTime="2026-06-10 12:06:22.45206323 +0000 UTC m=+177.040410090" Jun 10 12:06:22.465654 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:22.465631 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gq6mr_60f1beb1-dc58-45f0-8efb-8d879a73cd8e/serve-healthcheck-canary/0.log" Jun 10 12:06:23.550636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:23.549483 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:23.550636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:23.549592 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:23.550636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:23.550059 2576 scope.go:117] "RemoveContainer" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" Jun 10 12:06:23.550636 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:23.550253 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:29.127699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.127663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:29.128142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.127718 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:29.128142 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:29.127881 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:29.128142 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:29.127983 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls podName:76ff5d25-7211-448b-81d5-b9d082c6d06d nodeName:}" failed. No retries permitted until 2026-06-10 12:06:45.127966996 +0000 UTC m=+199.716313840 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-2dlgm" (UID: "76ff5d25-7211-448b-81d5-b9d082c6d06d") : secret "cluster-monitoring-operator-tls" not found Jun 10 12:06:29.130264 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.130242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"image-registry-5c98dcbd9f-76d24\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:29.163094 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.163071 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nxsql\"" Jun 10 12:06:29.169650 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.169629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:29.292724 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.292686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:06:29.300445 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:29.299418 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8402ae_d84d_4f93_9bec_f087ae12d150.slice/crio-ac492593c227ec6409dd9fff6fb986288815178469b52fd64285e20d9edc1cbb WatchSource:0}: Error finding container ac492593c227ec6409dd9fff6fb986288815178469b52fd64285e20d9edc1cbb: Status 404 returned error can't find the container with id ac492593c227ec6409dd9fff6fb986288815178469b52fd64285e20d9edc1cbb Jun 10 12:06:29.463697 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.463667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" event={"ID":"9f8402ae-d84d-4f93-9bec-f087ae12d150","Type":"ContainerStarted","Data":"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b"} Jun 10 12:06:29.463866 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.463754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" event={"ID":"9f8402ae-d84d-4f93-9bec-f087ae12d150","Type":"ContainerStarted","Data":"ac492593c227ec6409dd9fff6fb986288815178469b52fd64285e20d9edc1cbb"} Jun 10 12:06:29.463866 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.463782 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:06:29.484728 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:29.484667 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" podStartSLOduration=16.484648205 podStartE2EDuration="16.484648205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:29.484034786 +0000 UTC m=+184.072381647" watchObservedRunningTime="2026-06-10 12:06:29.484648205 +0000 UTC m=+184.072995068" Jun 10 12:06:38.893716 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:38.893686 2576 scope.go:117] "RemoveContainer" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" Jun 10 12:06:39.493667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.493640 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:06:39.494077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.494063 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/1.log" Jun 10 12:06:39.494131 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.494095 2576 generic.go:356] "Generic (PLEG): container finished" podID="4ac11464-3642-44c1-a3b3-f5313da89b24" containerID="a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d" exitCode=255 Jun 10 12:06:39.494166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.494157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" event={"ID":"4ac11464-3642-44c1-a3b3-f5313da89b24","Type":"ContainerDied","Data":"a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d"} Jun 10 12:06:39.494204 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.494197 2576 scope.go:117] "RemoveContainer" containerID="e64053cad471a13fcf44d48952b0c171a3cd2de75f8f76ba390584c1d14c3add" Jun 10 12:06:39.494508 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:39.494481 2576 scope.go:117] "RemoveContainer" containerID="a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d" Jun 10 12:06:39.494675 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:39.494650 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:40.075662 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.075630 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-h7mvq"] Jun 10 12:06:40.094806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.094776 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:06:40.094806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.094813 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7mvq"] Jun 10 12:06:40.095005 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.094922 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.098790 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.098760 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mkwwn\"" Jun 10 12:06:40.100809 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.099524 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 12:06:40.100809 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.099545 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 12:06:40.163099 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.163064 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-664c787486-zrh7f"] Jun 10 12:06:40.181142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.181118 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.210656 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.210632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-664c787486-zrh7f"] Jun 10 12:06:40.212888 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.212869 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-certificates\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.212967 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.212916 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b261105-87a3-4a16-89ce-2a99c2a1fc05-data-volume\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.213019 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.212996 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvlvs\" (UniqueName: \"kubernetes.io/projected/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-api-access-jvlvs\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.213064 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-ca-trust-extracted\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213109 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b261105-87a3-4a16-89ce-2a99c2a1fc05-crio-socket\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.213109 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213078 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-bound-sa-token\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213109 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213092 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqwk6\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-kube-api-access-dqwk6\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213128 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-trusted-ca\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213153 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-installation-pull-secrets\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b261105-87a3-4a16-89ce-2a99c2a1fc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.213299 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213231 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-image-registry-private-configuration\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.213299 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213278 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.213299 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.213293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-tls\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314054 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-trusted-ca\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-installation-pull-secrets\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b261105-87a3-4a16-89ce-2a99c2a1fc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.314233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314103 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-image-registry-private-configuration\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.314233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314228 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-tls\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-certificates\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b261105-87a3-4a16-89ce-2a99c2a1fc05-data-volume\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.314404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314369 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvlvs\" (UniqueName: \"kubernetes.io/projected/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-api-access-jvlvs\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.314404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314393 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-ca-trust-extracted\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314561 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b261105-87a3-4a16-89ce-2a99c2a1fc05-crio-socket\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.314561 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314450 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-bound-sa-token\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314561 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314474 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqwk6\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-kube-api-access-dqwk6\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.314832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b261105-87a3-4a16-89ce-2a99c2a1fc05-data-volume\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.315003 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314820 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6b261105-87a3-4a16-89ce-2a99c2a1fc05-crio-socket\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.315112 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.314830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-ca-trust-extracted\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.315304 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.315274 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.315396 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.315316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-trusted-ca\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.315396 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.315376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-certificates\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.316858 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.316828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6b261105-87a3-4a16-89ce-2a99c2a1fc05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.316981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.316899 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-image-registry-private-configuration\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.317341 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.317315 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-installation-pull-secrets\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.317618 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.317602 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-registry-tls\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.327588 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.327524 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqwk6\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-kube-api-access-dqwk6\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.327963 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.327942 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8-bound-sa-token\") pod \"image-registry-664c787486-zrh7f\" (UID: \"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8\") " pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.328284 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.328266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvlvs\" (UniqueName: \"kubernetes.io/projected/6b261105-87a3-4a16-89ce-2a99c2a1fc05-kube-api-access-jvlvs\") pod \"insights-runtime-extractor-h7mvq\" (UID: \"6b261105-87a3-4a16-89ce-2a99c2a1fc05\") " pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.406366 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.406339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-h7mvq" Jun 10 12:06:40.489345 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.489318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:40.498518 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.498490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:06:40.549166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.549097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-h7mvq"] Jun 10 12:06:40.555454 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:40.555140 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b261105_87a3_4a16_89ce_2a99c2a1fc05.slice/crio-66c20e7395908f075654340839c4f72623029190a8c47e0813aa1f3bfc3f827d WatchSource:0}: Error finding container 66c20e7395908f075654340839c4f72623029190a8c47e0813aa1f3bfc3f827d: Status 404 returned error can't find the container with id 66c20e7395908f075654340839c4f72623029190a8c47e0813aa1f3bfc3f827d Jun 10 12:06:40.624347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:40.624320 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-664c787486-zrh7f"] Jun 10 12:06:40.627125 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:40.627102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3b5cf50_e8a3_43bb_aea4_bc0f9b9b0ec8.slice/crio-c57a0f70353fcf5d76da8f9151a6d25210779b6a3df5baf4dc1a950f927c2d74 WatchSource:0}: Error finding container c57a0f70353fcf5d76da8f9151a6d25210779b6a3df5baf4dc1a950f927c2d74: Status 404 returned error can't find the container with id c57a0f70353fcf5d76da8f9151a6d25210779b6a3df5baf4dc1a950f927c2d74 Jun 10 12:06:41.503474 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.503410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-664c787486-zrh7f" event={"ID":"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8","Type":"ContainerStarted","Data":"af21b9f5b672c3ba1adabcbe62a5e662b75fcb938eeb5df4975957e23db83ed5"} Jun 10 12:06:41.503808 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.503473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-664c787486-zrh7f" event={"ID":"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8","Type":"ContainerStarted","Data":"c57a0f70353fcf5d76da8f9151a6d25210779b6a3df5baf4dc1a950f927c2d74"} Jun 10 12:06:41.503808 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.503503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:06:41.505577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.505556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7mvq" event={"ID":"6b261105-87a3-4a16-89ce-2a99c2a1fc05","Type":"ContainerStarted","Data":"b5d4fa7b4610160f8e57ad93003728d931a023f0290c50b42a309c8e2ded2c30"} Jun 10 12:06:41.505695 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.505610 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7mvq" event={"ID":"6b261105-87a3-4a16-89ce-2a99c2a1fc05","Type":"ContainerStarted","Data":"cf5618836118bf1c1bdc527e6889b886ccf7f1da9c1516477671895230e16d53"} Jun 10 12:06:41.505695 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:41.505640 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7mvq" event={"ID":"6b261105-87a3-4a16-89ce-2a99c2a1fc05","Type":"ContainerStarted","Data":"66c20e7395908f075654340839c4f72623029190a8c47e0813aa1f3bfc3f827d"} Jun 10 12:06:43.515277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.515237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-h7mvq" event={"ID":"6b261105-87a3-4a16-89ce-2a99c2a1fc05","Type":"ContainerStarted","Data":"fca3835544d02084483397739d0a064ef611ce0bfc7d3ecfebe88244908624fa"} Jun 10 12:06:43.533018 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.532966 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-h7mvq" podStartSLOduration=1.5241865350000001 podStartE2EDuration="3.532949603s" totalImagesPullingTime="2.008763068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:06:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:43.532494198 +0000 UTC m=+198.120841059" watchObservedRunningTime="2026-06-10 12:06:43.532949603 +0000 UTC m=+198.121296454" Jun 10 12:06:43.533186 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.533058 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podStartSLOduration=3.53305357 podStartE2EDuration="3.53305357s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:41.523123398 +0000 UTC m=+196.111470257" watchObservedRunningTime="2026-06-10 12:06:43.53305357 +0000 UTC m=+198.121400429" Jun 10 12:06:43.548740 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.548713 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:43.548798 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.548766 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:06:43.549134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:43.549118 2576 scope.go:117] "RemoveContainer" containerID="a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d" Jun 10 12:06:43.549294 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:43.549276 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:45.155293 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.155247 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:45.157650 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.157622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/76ff5d25-7211-448b-81d5-b9d082c6d06d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-2dlgm\" (UID: \"76ff5d25-7211-448b-81d5-b9d082c6d06d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:45.368263 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.368232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qswhm\"" Jun 10 12:06:45.376371 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.376347 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" Jun 10 12:06:45.496660 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.496624 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm"] Jun 10 12:06:45.499424 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:45.499399 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76ff5d25_7211_448b_81d5_b9d082c6d06d.slice/crio-378d636a25034c842a4f23237ac80a1ef095ccafac0628d21cb17920ca79f1f0 WatchSource:0}: Error finding container 378d636a25034c842a4f23237ac80a1ef095ccafac0628d21cb17920ca79f1f0: Status 404 returned error can't find the container with id 378d636a25034c842a4f23237ac80a1ef095ccafac0628d21cb17920ca79f1f0 Jun 10 12:06:45.522373 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:45.522345 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" event={"ID":"76ff5d25-7211-448b-81d5-b9d082c6d06d","Type":"ContainerStarted","Data":"378d636a25034c842a4f23237ac80a1ef095ccafac0628d21cb17920ca79f1f0"} Jun 10 12:06:47.533258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:47.533217 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" event={"ID":"76ff5d25-7211-448b-81d5-b9d082c6d06d","Type":"ContainerStarted","Data":"d619df426e68fc4b8f986f9da7aa95e99cb590550458559d739caf6660b12fb1"} Jun 10 12:06:47.549654 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:47.549589 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-2dlgm" podStartSLOduration=32.667304665 podStartE2EDuration="34.549568871s" totalImagesPullingTime="1.882264206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:47.548377226 +0000 UTC m=+202.136724085" watchObservedRunningTime="2026-06-10 12:06:47.549568871 +0000 UTC m=+202.137915732" Jun 10 12:06:50.100500 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.100457 2576 patch_prober.go:28] interesting pod/image-registry-5c98dcbd9f-76d24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:06:50.100859 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.100523 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:06:50.949271 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.949240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq"] Jun 10 12:06:50.951424 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.951410 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:50.955515 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.955488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 10 12:06:50.955515 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.955505 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 12:06:50.955708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.955505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-n7r8k\"" Jun 10 12:06:50.955708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.955492 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 10 12:06:50.963489 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:50.963466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq"] Jun 10 12:06:51.000834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.000794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e07b6-802b-430d-bd18-a678c559eba8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.001044 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.000860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.001044 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.000951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6h2g\" (UniqueName: \"kubernetes.io/projected/5f9e07b6-802b-430d-bd18-a678c559eba8-kube-api-access-r6h2g\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.001044 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.000994 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.102307 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.102268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.102754 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.102324 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e07b6-802b-430d-bd18-a678c559eba8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.102754 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.102362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.102754 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:51.102425 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 10 12:06:51.102754 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.102465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6h2g\" (UniqueName: \"kubernetes.io/projected/5f9e07b6-802b-430d-bd18-a678c559eba8-kube-api-access-r6h2g\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.102754 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:51.102485 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls podName:5f9e07b6-802b-430d-bd18-a678c559eba8 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:51.602470234 +0000 UTC m=+206.190817072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-c8jsq" (UID: "5f9e07b6-802b-430d-bd18-a678c559eba8") : secret "prometheus-operator-tls" not found Jun 10 12:06:51.103178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.103157 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5f9e07b6-802b-430d-bd18-a678c559eba8-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.104745 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.104722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.111472 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.111441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6h2g\" (UniqueName: \"kubernetes.io/projected/5f9e07b6-802b-430d-bd18-a678c559eba8-kube-api-access-r6h2g\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.606087 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.606049 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.608452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.608420 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f9e07b6-802b-430d-bd18-a678c559eba8-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-c8jsq\" (UID: \"5f9e07b6-802b-430d-bd18-a678c559eba8\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.860340 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.860238 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" Jun 10 12:06:51.985462 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:51.985429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq"] Jun 10 12:06:51.987952 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:51.987911 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9e07b6_802b_430d_bd18_a678c559eba8.slice/crio-7900c7588082d5ad739ed83556121bbecdcd335c92efd09279fd2bacdf3bfe65 WatchSource:0}: Error finding container 7900c7588082d5ad739ed83556121bbecdcd335c92efd09279fd2bacdf3bfe65: Status 404 returned error can't find the container with id 7900c7588082d5ad739ed83556121bbecdcd335c92efd09279fd2bacdf3bfe65 Jun 10 12:06:52.550766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:52.550732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" event={"ID":"5f9e07b6-802b-430d-bd18-a678c559eba8","Type":"ContainerStarted","Data":"7900c7588082d5ad739ed83556121bbecdcd335c92efd09279fd2bacdf3bfe65"} Jun 10 12:06:53.555677 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:53.555644 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" event={"ID":"5f9e07b6-802b-430d-bd18-a678c559eba8","Type":"ContainerStarted","Data":"c3f55073a00335628d82c00abfc69c5103ddf646cfb8eea434bfba49837e40dd"} Jun 10 12:06:53.556074 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:53.555694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" event={"ID":"5f9e07b6-802b-430d-bd18-a678c559eba8","Type":"ContainerStarted","Data":"10f96363dee543089ce6af54c1b4c5f8f73f6a86e787fa94dbd538a5915b0528"} Jun 10 12:06:53.576290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:53.576211 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-c8jsq" podStartSLOduration=2.214439706 podStartE2EDuration="3.57619203s" totalImagesPullingTime="1.361752324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:53.573692837 +0000 UTC m=+208.162039699" watchObservedRunningTime="2026-06-10 12:06:53.57619203 +0000 UTC m=+208.164538894" Jun 10 12:06:55.350357 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.350318 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs"] Jun 10 12:06:55.353285 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.353266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.356115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.356091 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 10 12:06:55.356247 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.356142 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 10 12:06:55.357379 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.357360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5wqc9\"" Jun 10 12:06:55.357491 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.357368 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 10 12:06:55.361053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.360988 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-j7fk9"] Jun 10 12:06:55.363329 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.363312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.366262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.366243 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs"] Jun 10 12:06:55.366409 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.366249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gzc2k\"" Jun 10 12:06:55.366522 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.366504 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 12:06:55.366598 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.366265 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 12:06:55.366661 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.366459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 12:06:55.435337 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435305 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnmk\" (UniqueName: \"kubernetes.io/projected/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-api-access-dqnmk\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435350 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435418 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-textfile\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435459 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-metrics-client-ca\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435512 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435523 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-wtmp\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435605 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435625 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435663 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435870 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-root\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435870 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435693 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2e8539b-e0d8-46e7-a604-cc325f65fad7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.435870 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435712 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kblwx\" (UniqueName: \"kubernetes.io/projected/fda64f5e-b014-49a7-a1d8-c78aef725fd4-kube-api-access-kblwx\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.435870 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.435796 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-sys\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-sys\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnmk\" (UniqueName: \"kubernetes.io/projected/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-api-access-dqnmk\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536855 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-textfile\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-metrics-client-ca\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.536979 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-wtmp\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537105 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-root\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537220 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2e8539b-e0d8-46e7-a604-cc325f65fad7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537245 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kblwx\" (UniqueName: \"kubernetes.io/projected/fda64f5e-b014-49a7-a1d8-c78aef725fd4-kube-api-access-kblwx\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.538232 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.537401 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-sys\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.539143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.538170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-accelerators-collector-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.539143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.538390 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-textfile\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.539143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.538848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fda64f5e-b014-49a7-a1d8-c78aef725fd4-metrics-client-ca\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.539143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.538996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-wtmp\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.539623 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.539596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.540419 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.539774 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fda64f5e-b014-49a7-a1d8-c78aef725fd4-root\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.540419 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.540094 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/d2e8539b-e0d8-46e7-a604-cc325f65fad7-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.540419 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:55.540164 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 12:06:55.540419 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:55.540224 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls podName:fda64f5e-b014-49a7-a1d8-c78aef725fd4 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:56.040207025 +0000 UTC m=+210.628553879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls") pod "node-exporter-j7fk9" (UID: "fda64f5e-b014-49a7-a1d8-c78aef725fd4") : secret "node-exporter-tls" not found Jun 10 12:06:55.540419 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.540239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e8539b-e0d8-46e7-a604-cc325f65fad7-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.540725 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.540677 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.543108 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.543083 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.543991 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.543970 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.546700 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.546670 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnmk\" (UniqueName: \"kubernetes.io/projected/d2e8539b-e0d8-46e7-a604-cc325f65fad7-kube-api-access-dqnmk\") pod \"kube-state-metrics-57bbf8bfb5-9scqs\" (UID: \"d2e8539b-e0d8-46e7-a604-cc325f65fad7\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.547284 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.547262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kblwx\" (UniqueName: \"kubernetes.io/projected/fda64f5e-b014-49a7-a1d8-c78aef725fd4-kube-api-access-kblwx\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:55.664600 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.664521 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" Jun 10 12:06:55.802118 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:55.802093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs"] Jun 10 12:06:55.804180 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:55.804141 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e8539b_e0d8_46e7_a604_cc325f65fad7.slice/crio-83c9b0d9a72700452370d40dbfc0f29ada9cee6a62bf79f5fe2ce5a930d368d9 WatchSource:0}: Error finding container 83c9b0d9a72700452370d40dbfc0f29ada9cee6a62bf79f5fe2ce5a930d368d9: Status 404 returned error can't find the container with id 83c9b0d9a72700452370d40dbfc0f29ada9cee6a62bf79f5fe2ce5a930d368d9 Jun 10 12:06:56.042307 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:56.042270 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:56.044523 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:56.044492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fda64f5e-b014-49a7-a1d8-c78aef725fd4-node-exporter-tls\") pod \"node-exporter-j7fk9\" (UID: \"fda64f5e-b014-49a7-a1d8-c78aef725fd4\") " pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:56.273952 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:56.273911 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-j7fk9" Jun 10 12:06:56.284955 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:06:56.284913 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfda64f5e_b014_49a7_a1d8_c78aef725fd4.slice/crio-c362a99763fee62a840e419017340163a9e3f1c8ee7a579f92895dce333f83de WatchSource:0}: Error finding container c362a99763fee62a840e419017340163a9e3f1c8ee7a579f92895dce333f83de: Status 404 returned error can't find the container with id c362a99763fee62a840e419017340163a9e3f1c8ee7a579f92895dce333f83de Jun 10 12:06:56.568359 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:56.568320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" event={"ID":"d2e8539b-e0d8-46e7-a604-cc325f65fad7","Type":"ContainerStarted","Data":"83c9b0d9a72700452370d40dbfc0f29ada9cee6a62bf79f5fe2ce5a930d368d9"} Jun 10 12:06:56.569827 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:56.569790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7fk9" event={"ID":"fda64f5e-b014-49a7-a1d8-c78aef725fd4","Type":"ContainerStarted","Data":"c362a99763fee62a840e419017340163a9e3f1c8ee7a579f92895dce333f83de"} Jun 10 12:06:57.575777 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:57.575735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7fk9" event={"ID":"fda64f5e-b014-49a7-a1d8-c78aef725fd4","Type":"ContainerStarted","Data":"d5bf76a33e7da1fbf7912fedc0e4d6dca976a87e803756bd008dc5f074a1e59f"} Jun 10 12:06:57.577193 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:57.577170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" event={"ID":"d2e8539b-e0d8-46e7-a604-cc325f65fad7","Type":"ContainerStarted","Data":"cd5b8aef4858a16afd5db9eb264ad944a090043eaceb0df239a3e47af02a7c98"} Jun 10 12:06:57.894722 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:57.894683 2576 scope.go:117] "RemoveContainer" containerID="a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d" Jun 10 12:06:57.894925 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:06:57.894901 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-jprdj_openshift-console-operator(4ac11464-3642-44c1-a3b3-f5313da89b24)\"" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podUID="4ac11464-3642-44c1-a3b3-f5313da89b24" Jun 10 12:06:58.581746 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:58.581712 2576 generic.go:356] "Generic (PLEG): container finished" podID="fda64f5e-b014-49a7-a1d8-c78aef725fd4" containerID="d5bf76a33e7da1fbf7912fedc0e4d6dca976a87e803756bd008dc5f074a1e59f" exitCode=0 Jun 10 12:06:58.582188 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:58.581803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7fk9" event={"ID":"fda64f5e-b014-49a7-a1d8-c78aef725fd4","Type":"ContainerDied","Data":"d5bf76a33e7da1fbf7912fedc0e4d6dca976a87e803756bd008dc5f074a1e59f"} Jun 10 12:06:58.586470 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:58.586224 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" event={"ID":"d2e8539b-e0d8-46e7-a604-cc325f65fad7","Type":"ContainerStarted","Data":"b8e5ff68b73d9e810ee84bb441afbc2c9fb232cbe6756382427daa3209c36b23"} Jun 10 12:06:58.586470 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:58.586280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" event={"ID":"d2e8539b-e0d8-46e7-a604-cc325f65fad7","Type":"ContainerStarted","Data":"c8d8bd8ae3bbfa20cd016b7fad204ff956cdac818353598c9e1cbb43778fb884"} Jun 10 12:06:58.622373 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:58.622323 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-9scqs" podStartSLOduration=1.96190853 podStartE2EDuration="3.62230664s" totalImagesPullingTime="1.66039811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:58.621032781 +0000 UTC m=+213.209379645" watchObservedRunningTime="2026-06-10 12:06:58.62230664 +0000 UTC m=+213.210653499" Jun 10 12:06:59.591779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:59.591748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7fk9" event={"ID":"fda64f5e-b014-49a7-a1d8-c78aef725fd4","Type":"ContainerStarted","Data":"6724bf310e988235877b6f6e4467c7292466fb887655a3876669e82211603ae2"} Jun 10 12:06:59.592223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:59.591827 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-j7fk9" event={"ID":"fda64f5e-b014-49a7-a1d8-c78aef725fd4","Type":"ContainerStarted","Data":"6fbed4d7496447794d825db2c18a6f72fa50f19aea8307e1af863601c0863b1f"} Jun 10 12:06:59.612842 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:06:59.612795 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-j7fk9" podStartSLOduration=3.349977893 podStartE2EDuration="4.612779775s" totalImagesPullingTime="1.182270701s" totalInitContainerRuntime="80.531181ms" isStatefulPod=true podCreationTimestamp="2026-06-10 12:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:59.610845646 +0000 UTC m=+214.199192506" watchObservedRunningTime="2026-06-10 12:06:59.612779775 +0000 UTC m=+214.201126675" Jun 10 12:07:00.099990 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.099959 2576 patch_prober.go:28] interesting pod/image-registry-5c98dcbd9f-76d24 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:00.100142 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.100011 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:00.493412 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.493372 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:00.493578 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.493427 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:00.531712 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.531678 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8"] Jun 10 12:07:00.534030 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.534012 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.536805 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.536772 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 10 12:07:00.536927 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.536866 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 10 12:07:00.536927 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.536910 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 10 12:07:00.537084 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.537002 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 10 12:07:00.537193 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.537112 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kw4rv\"" Jun 10 12:07:00.537193 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.537169 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 10 12:07:00.542553 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.542533 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 10 12:07:00.547859 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.547837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8"] Jun 10 12:07:00.682527 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6zpt\" (UniqueName: \"kubernetes.io/projected/69c45575-2f72-497f-9d30-7c1efb744022-kube-api-access-z6zpt\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-federate-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682679 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-serving-certs-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.682961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.682838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-metrics-client-ca\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784119 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784119 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6zpt\" (UniqueName: \"kubernetes.io/projected/69c45575-2f72-497f-9d30-7c1efb744022-kube-api-access-z6zpt\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784203 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-federate-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-serving-certs-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784323 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784311 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.784561 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.784342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-metrics-client-ca\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.785048 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.785019 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-serving-certs-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.785186 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.785056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.785186 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.785060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69c45575-2f72-497f-9d30-7c1efb744022-metrics-client-ca\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.786831 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.786807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.786920 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.786812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-telemeter-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.787068 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.787051 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-federate-client-tls\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.787217 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.787195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/69c45575-2f72-497f-9d30-7c1efb744022-secret-telemeter-client\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.792293 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.792273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6zpt\" (UniqueName: \"kubernetes.io/projected/69c45575-2f72-497f-9d30-7c1efb744022-kube-api-access-z6zpt\") pod \"telemeter-client-7f67b65b6f-hpbp8\" (UID: \"69c45575-2f72-497f-9d30-7c1efb744022\") " pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.843559 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.843534 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" Jun 10 12:07:00.966806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:00.966774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8"] Jun 10 12:07:00.969890 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:07:00.969863 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69c45575_2f72_497f_9d30_7c1efb744022.slice/crio-cdf780490552452c154f78515b0c6a963490d4cf6147a7d54eee3d4040a6d1a9 WatchSource:0}: Error finding container cdf780490552452c154f78515b0c6a963490d4cf6147a7d54eee3d4040a6d1a9: Status 404 returned error can't find the container with id cdf780490552452c154f78515b0c6a963490d4cf6147a7d54eee3d4040a6d1a9 Jun 10 12:07:01.605059 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:01.604975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" event={"ID":"69c45575-2f72-497f-9d30-7c1efb744022","Type":"ContainerStarted","Data":"cdf780490552452c154f78515b0c6a963490d4cf6147a7d54eee3d4040a6d1a9"} Jun 10 12:07:02.513896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:02.513862 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:02.514269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:02.513915 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:04.620679 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:04.620648 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" event={"ID":"69c45575-2f72-497f-9d30-7c1efb744022","Type":"ContainerStarted","Data":"1a91b46aeab4f5c38f6f9f24d14009ccbe0c4e3ada098662a5ec9793f4ae4e06"} Jun 10 12:07:05.116801 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.116767 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" containerID="cri-o://f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b" gracePeriod=30 Jun 10 12:07:05.356721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.356699 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:07:05.526148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526057 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526114 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526162 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526196 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526221 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpxcv\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526303 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526347 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets\") pod \"9f8402ae-d84d-4f93-9bec-f087ae12d150\" (UID: \"9f8402ae-d84d-4f93-9bec-f087ae12d150\") " Jun 10 12:07:05.526633 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526506 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:07:05.526688 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526627 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:07:05.526688 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.526644 2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-certificates\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.528674 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.528635 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:07:05.528787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.528683 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:07:05.528854 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.528797 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:05.528854 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.528802 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:05.528987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.528970 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv" (OuterVolumeSpecName: "kube-api-access-kpxcv") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "kube-api-access-kpxcv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:07:05.535162 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.535137 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9f8402ae-d84d-4f93-9bec-f087ae12d150" (UID: "9f8402ae-d84d-4f93-9bec-f087ae12d150"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:07:05.625897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.625859 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" event={"ID":"69c45575-2f72-497f-9d30-7c1efb744022","Type":"ContainerStarted","Data":"fd061ca6cf0b2093a3514cb0d9647fde36f1e54f0291b9c782f8b8e96a6d28e7"} Jun 10 12:07:05.626316 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.625988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" event={"ID":"69c45575-2f72-497f-9d30-7c1efb744022","Type":"ContainerStarted","Data":"40fc39ee242e8bad3f8e3a63fb335483af4fa1d18792eab88a9e2f6226296f58"} Jun 10 12:07:05.627023 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.626996 2576 generic.go:356] "Generic (PLEG): container finished" podID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerID="f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b" exitCode=0 Jun 10 12:07:05.627126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627043 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" Jun 10 12:07:05.627126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" event={"ID":"9f8402ae-d84d-4f93-9bec-f087ae12d150","Type":"ContainerDied","Data":"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b"} Jun 10 12:07:05.627126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627114 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5c98dcbd9f-76d24" event={"ID":"9f8402ae-d84d-4f93-9bec-f087ae12d150","Type":"ContainerDied","Data":"ac492593c227ec6409dd9fff6fb986288815178469b52fd64285e20d9edc1cbb"} Jun 10 12:07:05.627126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627040 2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9f8402ae-d84d-4f93-9bec-f087ae12d150-ca-trust-extracted\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627132 2576 scope.go:117] "RemoveContainer" containerID="f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627142 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9f8402ae-d84d-4f93-9bec-f087ae12d150-trusted-ca\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627161 2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-registry-tls\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627232 2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-bound-sa-token\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627247 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpxcv\" (UniqueName: \"kubernetes.io/projected/9f8402ae-d84d-4f93-9bec-f087ae12d150-kube-api-access-kpxcv\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627272 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627264 2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-image-registry-private-configuration\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.627495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.627279 2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9f8402ae-d84d-4f93-9bec-f087ae12d150-installation-pull-secrets\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:07:05.635450 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.635435 2576 scope.go:117] "RemoveContainer" containerID="f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b" Jun 10 12:07:05.635720 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:07:05.635701 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b\": container with ID starting with f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b not found: ID does not exist" containerID="f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b" Jun 10 12:07:05.635766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.635729 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b"} err="failed to get container status \"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b\": rpc error: code = NotFound desc = could not find container \"f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b\": container with ID starting with f51b72dfc4ff0defd4d355336c918cac14feb5b849a632b3c1d8a9fca3447a5b not found: ID does not exist" Jun 10 12:07:05.649188 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.649148 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7f67b65b6f-hpbp8" podStartSLOduration=1.71734288 podStartE2EDuration="5.649134973s" totalImagesPullingTime="3.931792093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:05.647283129 +0000 UTC m=+220.235630026" watchObservedRunningTime="2026-06-10 12:07:05.649134973 +0000 UTC m=+220.237481833" Jun 10 12:07:05.661586 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.661560 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:07:05.668716 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.668694 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5c98dcbd9f-76d24"] Jun 10 12:07:05.899081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:05.899005 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" path="/var/lib/kubelet/pods/9f8402ae-d84d-4f93-9bec-f087ae12d150/volumes" Jun 10 12:07:09.894704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:09.894671 2576 scope.go:117] "RemoveContainer" containerID="a165c46b70b8d013607979391b5d4e4a9f16e2d91aa1bd25f39130e986d85e5d" Jun 10 12:07:10.494086 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.494051 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:10.494353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.494329 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:10.648625 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.648600 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:07:10.648783 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.648677 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" event={"ID":"4ac11464-3642-44c1-a3b3-f5313da89b24","Type":"ContainerStarted","Data":"8d71fdf474f368dcedb33937c33bb042fd847da3e653e9894ae8ce7500d7436a"} Jun 10 12:07:10.649115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.648966 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:07:10.661329 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.661295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" Jun 10 12:07:10.669543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.669469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-jprdj" podStartSLOduration=54.799568551 podStartE2EDuration="57.669450831s" totalImagesPullingTime="2.86988228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:10.668394735 +0000 UTC m=+225.256741608" watchObservedRunningTime="2026-06-10 12:07:10.669450831 +0000 UTC m=+225.257797693" Jun 10 12:07:10.732111 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.732064 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-mtlhg"] Jun 10 12:07:10.732488 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.732468 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" Jun 10 12:07:10.732488 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.732488 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" Jun 10 12:07:10.732671 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.732546 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8402ae-d84d-4f93-9bec-f087ae12d150" containerName="registry" Jun 10 12:07:10.734738 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.734709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:10.737607 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.737442 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 10 12:07:10.737607 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.737498 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 10 12:07:10.737607 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.737493 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fhft4\"" Jun 10 12:07:10.744622 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.744571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mtlhg"] Jun 10 12:07:10.873514 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.873472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tzwl\" (UniqueName: \"kubernetes.io/projected/397c0aa2-2edc-47aa-8611-ea6080ff68dd-kube-api-access-5tzwl\") pod \"downloads-6657875f97-mtlhg\" (UID: \"397c0aa2-2edc-47aa-8611-ea6080ff68dd\") " pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:10.974347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.974312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tzwl\" (UniqueName: \"kubernetes.io/projected/397c0aa2-2edc-47aa-8611-ea6080ff68dd-kube-api-access-5tzwl\") pod \"downloads-6657875f97-mtlhg\" (UID: \"397c0aa2-2edc-47aa-8611-ea6080ff68dd\") " pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:10.983365 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:10.983337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tzwl\" (UniqueName: \"kubernetes.io/projected/397c0aa2-2edc-47aa-8611-ea6080ff68dd-kube-api-access-5tzwl\") pod \"downloads-6657875f97-mtlhg\" (UID: \"397c0aa2-2edc-47aa-8611-ea6080ff68dd\") " pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:11.046974 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:11.046888 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:11.171558 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:11.171511 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mtlhg"] Jun 10 12:07:11.175582 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:07:11.175553 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397c0aa2_2edc_47aa_8611_ea6080ff68dd.slice/crio-fd700cae45ee48d13fceb0b169aa72f9b26db2608bb5ffb852290e6e5ad5a22a WatchSource:0}: Error finding container fd700cae45ee48d13fceb0b169aa72f9b26db2608bb5ffb852290e6e5ad5a22a: Status 404 returned error can't find the container with id fd700cae45ee48d13fceb0b169aa72f9b26db2608bb5ffb852290e6e5ad5a22a Jun 10 12:07:11.653588 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:11.653551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mtlhg" event={"ID":"397c0aa2-2edc-47aa-8611-ea6080ff68dd","Type":"ContainerStarted","Data":"fd700cae45ee48d13fceb0b169aa72f9b26db2608bb5ffb852290e6e5ad5a22a"} Jun 10 12:07:12.514841 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:12.514799 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:12.515300 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:12.514854 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:20.493423 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.493390 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:20.493806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.493436 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:20.493806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.493476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:07:20.493919 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.493874 2576 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"af21b9f5b672c3ba1adabcbe62a5e662b75fcb938eeb5df4975957e23db83ed5"} pod="openshift-image-registry/image-registry-664c787486-zrh7f" containerMessage="Container registry failed liveness probe, will be restarted" Jun 10 12:07:20.497503 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.497477 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:20.497659 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.497513 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:20.637125 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.637094 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:07:20.641889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.641867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.646091 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646051 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 10 12:07:20.646224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zmc4f\"" Jun 10 12:07:20.646224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646110 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 10 12:07:20.646224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646053 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 10 12:07:20.646224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646160 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 10 12:07:20.646430 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.646399 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 10 12:07:20.653449 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.652896 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:07:20.757235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757151 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.757235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjgvh\" (UniqueName: \"kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.757235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.757498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.757498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.757498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.757375 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858003 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.857965 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858016 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858033 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjgvh\" (UniqueName: \"kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858143 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858813 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858765 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858813 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858808 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.858993 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.858807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.860452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.860426 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.860649 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.860625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.866015 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.865994 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjgvh\" (UniqueName: \"kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh\") pod \"console-56dd4cd66b-bks2p\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:20.958557 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:20.958526 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:21.101052 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:21.101021 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:07:21.102819 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:07:21.102789 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee3a048b_0247_4264_bc74_4a57b62e4d2a.slice/crio-c85d0a35d0576e5c3208f519e7a5ee1f081a21e600f864e84e0c6748b749a47e WatchSource:0}: Error finding container c85d0a35d0576e5c3208f519e7a5ee1f081a21e600f864e84e0c6748b749a47e: Status 404 returned error can't find the container with id c85d0a35d0576e5c3208f519e7a5ee1f081a21e600f864e84e0c6748b749a47e Jun 10 12:07:21.693307 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:21.693272 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd4cd66b-bks2p" event={"ID":"ee3a048b-0247-4264-bc74-4a57b62e4d2a","Type":"ContainerStarted","Data":"c85d0a35d0576e5c3208f519e7a5ee1f081a21e600f864e84e0c6748b749a47e"} Jun 10 12:07:29.419896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.419856 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:07:29.423609 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.423583 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.432890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.432694 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 10 12:07:29.433522 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.433494 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:07:29.543582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dgq\" (UniqueName: \"kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543759 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543742 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543956 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.543956 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.543819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644444 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644410 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644444 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99dgq\" (UniqueName: \"kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644860 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.644860 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.644769 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.645465 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.645438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.645611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.645499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.645611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.645534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.645611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.645551 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.647251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.647227 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.647432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.647412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.653362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.653337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dgq\" (UniqueName: \"kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq\") pod \"console-5bd74865c5-r5r92\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:29.736921 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:29.736889 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:30.499408 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:30.499363 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:30.499816 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:30.499427 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:31.639317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.639131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:07:31.641430 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:07:31.641395 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42a19b02_37d7_420a_a548_f0129f6f34c7.slice/crio-d8bb1ca872a71fda640cf27449130f429571bb791d0cd573c99ecb944424de86 WatchSource:0}: Error finding container d8bb1ca872a71fda640cf27449130f429571bb791d0cd573c99ecb944424de86: Status 404 returned error can't find the container with id d8bb1ca872a71fda640cf27449130f429571bb791d0cd573c99ecb944424de86 Jun 10 12:07:31.738900 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.738841 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mtlhg" event={"ID":"397c0aa2-2edc-47aa-8611-ea6080ff68dd","Type":"ContainerStarted","Data":"6ecaec000cb2f6e94ada2cb6bc8b37110628bca4259e465e6046d2638782e86f"} Jun 10 12:07:31.739102 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.739077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:31.740682 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.740629 2576 patch_prober.go:28] interesting pod/downloads-6657875f97-mtlhg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.20:8080/\": dial tcp 10.134.0.20:8080: connect: connection refused" start-of-body= Jun 10 12:07:31.740810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.740687 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-mtlhg" podUID="397c0aa2-2edc-47aa-8611-ea6080ff68dd" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.20:8080/\": dial tcp 10.134.0.20:8080: connect: connection refused" Jun 10 12:07:31.741130 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.741097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd4cd66b-bks2p" event={"ID":"ee3a048b-0247-4264-bc74-4a57b62e4d2a","Type":"ContainerStarted","Data":"3895e207320bf0cbc671c4655b705500f4018eba15b4ac5b18e9ad2e8d126c44"} Jun 10 12:07:31.743177 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.743142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74865c5-r5r92" event={"ID":"42a19b02-37d7-420a-a548-f0129f6f34c7","Type":"ContainerStarted","Data":"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55"} Jun 10 12:07:31.743268 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.743185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74865c5-r5r92" event={"ID":"42a19b02-37d7-420a-a548-f0129f6f34c7","Type":"ContainerStarted","Data":"d8bb1ca872a71fda640cf27449130f429571bb791d0cd573c99ecb944424de86"} Jun 10 12:07:31.758490 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.758389 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-mtlhg" podStartSLOduration=1.38717098 podStartE2EDuration="21.758369141s" totalImagesPullingTime="20.371198161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:31.757102653 +0000 UTC m=+246.345449527" watchObservedRunningTime="2026-06-10 12:07:31.758369141 +0000 UTC m=+246.346716004" Jun 10 12:07:31.775526 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.775474 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56dd4cd66b-bks2p" podStartSLOduration=1.369707852 podStartE2EDuration="11.775457058s" totalImagesPullingTime="10.405749206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:31.773348797 +0000 UTC m=+246.361695669" watchObservedRunningTime="2026-06-10 12:07:31.775457058 +0000 UTC m=+246.363803918" Jun 10 12:07:31.791188 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:31.791139 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bd74865c5-r5r92" podStartSLOduration=2.791121971 podStartE2EDuration="2.791121971s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:31.789506867 +0000 UTC m=+246.377853727" watchObservedRunningTime="2026-06-10 12:07:31.791121971 +0000 UTC m=+246.379468877" Jun 10 12:07:32.760641 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:32.760610 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-mtlhg" Jun 10 12:07:37.831085 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:37.831048 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:07:37.833750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:37.833722 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10-metrics-certs\") pod \"network-metrics-daemon-mgf74\" (UID: \"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10\") " pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:07:38.097772 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:38.097665 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjlvn\"" Jun 10 12:07:38.104662 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:38.104632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mgf74" Jun 10 12:07:38.304234 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:38.304106 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mgf74"] Jun 10 12:07:38.306710 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:07:38.306680 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8458f85_7d6d_4ecb_ba39_a8e1c1b1ee10.slice/crio-013bf9b422bfcf4406d89a99f4813e75c46480cfd83bba5ea8f889a6390a3aae WatchSource:0}: Error finding container 013bf9b422bfcf4406d89a99f4813e75c46480cfd83bba5ea8f889a6390a3aae: Status 404 returned error can't find the container with id 013bf9b422bfcf4406d89a99f4813e75c46480cfd83bba5ea8f889a6390a3aae Jun 10 12:07:38.776130 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:38.776091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgf74" event={"ID":"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10","Type":"ContainerStarted","Data":"013bf9b422bfcf4406d89a99f4813e75c46480cfd83bba5ea8f889a6390a3aae"} Jun 10 12:07:39.737642 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:39.737599 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:39.738103 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:39.737676 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:07:39.739287 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:39.739260 2576 patch_prober.go:28] interesting pod/console-5bd74865c5-r5r92 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 12:07:39.739416 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:39.739318 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd74865c5-r5r92" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 12:07:40.497658 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.497625 2576 patch_prober.go:28] interesting pod/image-registry-664c787486-zrh7f container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 10 12:07:40.497822 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.497671 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:07:40.786578 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.786481 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgf74" event={"ID":"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10","Type":"ContainerStarted","Data":"5d9ce983446c9255a33faa2637c89ad41710e8993389a445fb77e0740fddf05e"} Jun 10 12:07:40.786578 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.786545 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mgf74" event={"ID":"f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10","Type":"ContainerStarted","Data":"864c3114b9d5b7033b8a8d39184af0cd39dac26dfaec24119b31eb72307f6f0b"} Jun 10 12:07:40.803657 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.803602 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mgf74" podStartSLOduration=253.27225279499999 podStartE2EDuration="4m14.80358728s" totalImagesPullingTime="1.531334485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:40.801972351 +0000 UTC m=+255.390319203" watchObservedRunningTime="2026-06-10 12:07:40.80358728 +0000 UTC m=+255.391934143" Jun 10 12:07:40.958882 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.958848 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:40.959073 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.958906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:07:40.960319 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.960299 2576 patch_prober.go:28] interesting pod/console-56dd4cd66b-bks2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 10 12:07:40.960370 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:40.960341 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56dd4cd66b-bks2p" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 10 12:07:45.512416 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:45.512377 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-664c787486-zrh7f" podUID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerName="registry" containerID="cri-o://af21b9f5b672c3ba1adabcbe62a5e662b75fcb938eeb5df4975957e23db83ed5" gracePeriod=30 Jun 10 12:07:46.812743 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:46.812706 2576 generic.go:356] "Generic (PLEG): container finished" podID="c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8" containerID="af21b9f5b672c3ba1adabcbe62a5e662b75fcb938eeb5df4975957e23db83ed5" exitCode=0 Jun 10 12:07:46.813131 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:46.812783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-664c787486-zrh7f" event={"ID":"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8","Type":"ContainerDied","Data":"af21b9f5b672c3ba1adabcbe62a5e662b75fcb938eeb5df4975957e23db83ed5"} Jun 10 12:07:47.817657 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:47.817625 2576 generic.go:356] "Generic (PLEG): container finished" podID="653dc9bb-b8a7-44cc-9b3f-41dc265169d1" containerID="4cd6e0881a3d12dfaf60c6d651a6ef2cd3b0d1cf01740dcef3e3609f42917121" exitCode=0 Jun 10 12:07:47.818182 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:47.817701 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jpgbr" event={"ID":"653dc9bb-b8a7-44cc-9b3f-41dc265169d1","Type":"ContainerDied","Data":"4cd6e0881a3d12dfaf60c6d651a6ef2cd3b0d1cf01740dcef3e3609f42917121"} Jun 10 12:07:47.818182 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:47.818062 2576 scope.go:117] "RemoveContainer" containerID="4cd6e0881a3d12dfaf60c6d651a6ef2cd3b0d1cf01740dcef3e3609f42917121" Jun 10 12:07:47.819539 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:47.819513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-664c787486-zrh7f" event={"ID":"c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8","Type":"ContainerStarted","Data":"3bde5c222067abe64ed05e895f15b645a387557b78004330538bad3daa1a2728"} Jun 10 12:07:47.819664 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:47.819631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:07:48.825174 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:48.825145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-jpgbr" event={"ID":"653dc9bb-b8a7-44cc-9b3f-41dc265169d1","Type":"ContainerStarted","Data":"0eb40d433c6a5fa93ab2c37618c4e4c89cdc8cbe5b4ed9f7d747b57278fe83c1"} Jun 10 12:07:49.738366 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:49.738329 2576 patch_prober.go:28] interesting pod/console-5bd74865c5-r5r92 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 12:07:49.738539 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:49.738391 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd74865c5-r5r92" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 12:07:50.959557 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:50.959522 2576 patch_prober.go:28] interesting pod/console-56dd4cd66b-bks2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 10 12:07:50.959965 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:50.959574 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56dd4cd66b-bks2p" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 10 12:07:51.909617 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:51.909588 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2dlgm_76ff5d25-7211-448b-81d5-b9d082c6d06d/cluster-monitoring-operator/0.log" Jun 10 12:07:52.108733 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:52.108709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-state-metrics/0.log" Jun 10 12:07:52.311269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:52.311242 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-rbac-proxy-main/0.log" Jun 10 12:07:52.508620 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:52.508593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-rbac-proxy-self/0.log" Jun 10 12:07:54.308276 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:54.308244 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/init-textfile/0.log" Jun 10 12:07:54.510141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:54.510111 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/node-exporter/0.log" Jun 10 12:07:54.708839 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:54.708761 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/kube-rbac-proxy/0.log" Jun 10 12:07:56.910215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:56.910180 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-c8jsq_5f9e07b6-802b-430d-bd18-a678c559eba8/prometheus-operator/0.log" Jun 10 12:07:57.108400 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:57.108371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-c8jsq_5f9e07b6-802b-430d-bd18-a678c559eba8/kube-rbac-proxy/0.log" Jun 10 12:07:57.509132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:57.509104 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/telemeter-client/0.log" Jun 10 12:07:57.708425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:57.708398 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/reload/0.log" Jun 10 12:07:57.909974 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:57.909891 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/kube-rbac-proxy/0.log" Jun 10 12:07:59.509587 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:59.509550 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:07:59.712201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:59.712168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/3.log" Jun 10 12:07:59.738309 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:59.738279 2576 patch_prober.go:28] interesting pod/console-5bd74865c5-r5r92 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" start-of-body= Jun 10 12:07:59.738453 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:59.738336 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5bd74865c5-r5r92" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" probeResult="failure" output="Get \"https://10.134.0.22:8443/health\": dial tcp 10.134.0.22:8443: connect: connection refused" Jun 10 12:07:59.909597 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:07:59.909510 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56dd4cd66b-bks2p_ee3a048b-0247-4264-bc74-4a57b62e4d2a/console/0.log" Jun 10 12:08:00.109963 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:00.109922 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bd74865c5-r5r92_42a19b02-37d7-420a-a548-f0129f6f34c7/console/0.log" Jun 10 12:08:00.311320 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:00.311291 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-mtlhg_397c0aa2-2edc-47aa-8611-ea6080ff68dd/download-server/0.log" Jun 10 12:08:00.959823 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:00.959790 2576 patch_prober.go:28] interesting pod/console-56dd4cd66b-bks2p container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jun 10 12:08:00.960224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:00.959847 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56dd4cd66b-bks2p" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jun 10 12:08:02.109330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:02.109301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5p87_8be82b18-301f-4fdc-b41c-49295824e59f/dns-node-resolver/0.log" Jun 10 12:08:02.510015 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:02.509988 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-664c787486-zrh7f_c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8/registry/0.log" Jun 10 12:08:02.717174 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:02.717124 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-664c787486-zrh7f_c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8/registry/1.log" Jun 10 12:08:03.309186 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:03.309159 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zjdl4_ae6c156d-7315-4279-9950-ff2e9b42da0b/node-ca/0.log" Jun 10 12:08:03.909034 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:03.909008 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gq6mr_60f1beb1-dc58-45f0-8efb-8d879a73cd8e/serve-healthcheck-canary/0.log" Jun 10 12:08:07.364676 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:08:07.364636 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-wn6xg" podUID="ef18a3cb-ef28-4e84-83f3-77ca605680c1" Jun 10 12:08:07.899373 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:07.899338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:08.829586 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:08.829536 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-664c787486-zrh7f" Jun 10 12:08:09.742513 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:09.742466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:08:09.746562 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:09.746539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:08:09.804981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:09.804948 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:08:10.806012 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:10.805985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:10.808237 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:10.808211 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ef18a3cb-ef28-4e84-83f3-77ca605680c1-metrics-tls\") pod \"dns-default-wn6xg\" (UID: \"ef18a3cb-ef28-4e84-83f3-77ca605680c1\") " pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:10.902648 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:10.902613 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xc76w\"" Jun 10 12:08:10.910077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:10.910055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:11.051729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:11.051705 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wn6xg"] Jun 10 12:08:11.053741 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:08:11.053703 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef18a3cb_ef28_4e84_83f3_77ca605680c1.slice/crio-59e85de7a18160d596024daffedd6345bfcb294b1fab1998037f3fcce99002cd WatchSource:0}: Error finding container 59e85de7a18160d596024daffedd6345bfcb294b1fab1998037f3fcce99002cd: Status 404 returned error can't find the container with id 59e85de7a18160d596024daffedd6345bfcb294b1fab1998037f3fcce99002cd Jun 10 12:08:11.914547 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:11.914513 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wn6xg" event={"ID":"ef18a3cb-ef28-4e84-83f3-77ca605680c1","Type":"ContainerStarted","Data":"59e85de7a18160d596024daffedd6345bfcb294b1fab1998037f3fcce99002cd"} Jun 10 12:08:12.662719 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.662681 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:08:12.685206 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.685181 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:08:12.685358 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.685311 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724092 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4fgf\" (UniqueName: \"kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724219 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.724451 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.724415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.825959 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.825910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.825995 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826027 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4fgf\" (UniqueName: \"kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826160 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826841 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.826841 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.827041 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.827041 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.826960 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.829312 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.829261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.829419 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.829364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.836082 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.836055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4fgf\" (UniqueName: \"kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf\") pod \"console-869ffb8b84-z7r8j\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:12.996862 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:12.996825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:13.132212 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.132188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:08:13.301156 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:08:13.301092 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e3d6469_d119_4f3a_bdb9_796868e4c626.slice/crio-dfa4d7048da50c4512b75e0682b8b2d68c6826a387fb224867c4d5fbce710b40 WatchSource:0}: Error finding container dfa4d7048da50c4512b75e0682b8b2d68c6826a387fb224867c4d5fbce710b40: Status 404 returned error can't find the container with id dfa4d7048da50c4512b75e0682b8b2d68c6826a387fb224867c4d5fbce710b40 Jun 10 12:08:13.923594 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.923505 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wn6xg" event={"ID":"ef18a3cb-ef28-4e84-83f3-77ca605680c1","Type":"ContainerStarted","Data":"ebf0eb519242c62707fde8d7b89250a6af7fccb01c2277b163206a8c09f9ee42"} Jun 10 12:08:13.923594 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.923561 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wn6xg" event={"ID":"ef18a3cb-ef28-4e84-83f3-77ca605680c1","Type":"ContainerStarted","Data":"e92a50663e53fb4f7e85cd19b850652cfa2088f4891b3462eaa76efcc034d569"} Jun 10 12:08:13.923594 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.923593 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:13.925077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.925055 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869ffb8b84-z7r8j" event={"ID":"1e3d6469-d119-4f3a-bdb9-796868e4c626","Type":"ContainerStarted","Data":"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d"} Jun 10 12:08:13.925181 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.925089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869ffb8b84-z7r8j" event={"ID":"1e3d6469-d119-4f3a-bdb9-796868e4c626","Type":"ContainerStarted","Data":"dfa4d7048da50c4512b75e0682b8b2d68c6826a387fb224867c4d5fbce710b40"} Jun 10 12:08:13.940976 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.940907 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wn6xg" podStartSLOduration=251.668675121 podStartE2EDuration="4m13.940893704s" totalImagesPullingTime="2.272218583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:13.939581873 +0000 UTC m=+288.527928733" watchObservedRunningTime="2026-06-10 12:08:13.940893704 +0000 UTC m=+288.529240563" Jun 10 12:08:13.955984 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:13.955923 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-869ffb8b84-z7r8j" podStartSLOduration=1.955907464 podStartE2EDuration="1.955907464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:13.955467972 +0000 UTC m=+288.543814854" watchObservedRunningTime="2026-06-10 12:08:13.955907464 +0000 UTC m=+288.544254324" Jun 10 12:08:17.389248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.389211 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:17.417858 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.417825 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:17.418037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.417974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.421143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421113 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mm4z7\"" Jun 10 12:08:17.421143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421129 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 12:08:17.421336 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421154 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 12:08:17.421336 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 12:08:17.421485 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 12:08:17.421573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 12:08:17.421573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421520 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 12:08:17.421573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.421467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 12:08:17.422390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.422373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 12:08:17.425766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.425749 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 12:08:17.470710 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470681 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-web-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470821 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470909 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.470978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.470951 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.471098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.471016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.471098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.471040 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.471098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.471062 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-out\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.471098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.471077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.471098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.471093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbqdd\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-kube-api-access-wbqdd\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572551 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572551 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572554 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-out\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572661 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbqdd\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-kube-api-access-wbqdd\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572722 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-web-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.572787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.572781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.573580 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.573523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.573580 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.573561 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.573870 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.573627 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80d1f15d-231f-4bd0-b241-a8730e5e6496-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.576341 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.576313 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-volume\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.576436 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.576360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.576436 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.576361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-web-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.576532 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.576468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.577070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.577050 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.577172 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.577152 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.577256 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.577238 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-tls-assets\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.578498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.578460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/80d1f15d-231f-4bd0-b241-a8730e5e6496-config-out\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.580205 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.580183 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/80d1f15d-231f-4bd0-b241-a8730e5e6496-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.583289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.583266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbqdd\" (UniqueName: \"kubernetes.io/projected/80d1f15d-231f-4bd0-b241-a8730e5e6496-kube-api-access-wbqdd\") pod \"alertmanager-main-0\" (UID: \"80d1f15d-231f-4bd0-b241-a8730e5e6496\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.731594 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.731481 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.901587 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.901531 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:17.907171 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:08:17.907140 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d1f15d_231f_4bd0_b241_a8730e5e6496.slice/crio-58d45a01fa5b9cdeec111fad0d6625e437ca82ed3954004b503e5d749e279587 WatchSource:0}: Error finding container 58d45a01fa5b9cdeec111fad0d6625e437ca82ed3954004b503e5d749e279587: Status 404 returned error can't find the container with id 58d45a01fa5b9cdeec111fad0d6625e437ca82ed3954004b503e5d749e279587 Jun 10 12:08:17.945573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:17.945551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"58d45a01fa5b9cdeec111fad0d6625e437ca82ed3954004b503e5d749e279587"} Jun 10 12:08:18.951363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:18.951329 2576 generic.go:356] "Generic (PLEG): container finished" podID="80d1f15d-231f-4bd0-b241-a8730e5e6496" containerID="3e8dad9cf86a1f4a6fb25cd0e121eda6fa23e4961d9a9164a4af7e52758c4461" exitCode=0 Jun 10 12:08:18.951738 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:18.951371 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerDied","Data":"3e8dad9cf86a1f4a6fb25cd0e121eda6fa23e4961d9a9164a4af7e52758c4461"} Jun 10 12:08:20.967072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:20.967041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"e135b78ce2f6ac9755761cfb5063ae0d7c1fed3d8216e3b397e59c7838f7d241"} Jun 10 12:08:20.967418 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:20.967138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"5a221400448f707ef5cb529a663a285ffb07ede81e31d404d1cbc089cb5221a3"} Jun 10 12:08:20.967418 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:20.967166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"781ccb78eb4a16650755b415027339bcb9d9b6a097e66af1c1e78f1458e15bd5"} Jun 10 12:08:20.967418 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:20.967190 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"34f5b342bd9ceedaa3f8f4b0f8b55f34c530e0c317b1aa0e883e9b9f54a534c3"} Jun 10 12:08:20.967418 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:20.967216 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"b6414bb338532d051a33d25f8e8e953b288f87361f04f5a18d83109cfd6e599d"} Jun 10 12:08:21.975462 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:21.975430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"80d1f15d-231f-4bd0-b241-a8730e5e6496","Type":"ContainerStarted","Data":"45f8f9a83080d6865777b9b994d476b7a173a45dffcdd7f022a259c0399a94e7"} Jun 10 12:08:22.007266 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:22.007216 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.69538413 podStartE2EDuration="5.007201405s" totalImagesPullingTime="2.292496478s" totalInitContainerRuntime="19.320797ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:22.004271563 +0000 UTC m=+296.592618459" watchObservedRunningTime="2026-06-10 12:08:22.007201405 +0000 UTC m=+296.595548265" Jun 10 12:08:22.997533 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:22.997503 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:22.997922 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:22.997579 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:23.002448 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:23.002426 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:23.931776 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:23.931746 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wn6xg" Jun 10 12:08:23.988105 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:23.988077 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:08:24.039673 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:24.039639 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:08:25.837807 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:25.837776 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:08:25.838228 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:25.837777 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:08:25.843724 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:25.843703 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:08:25.843895 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:25.843879 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:08:25.848276 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:25.848261 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:08:34.825284 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:34.825247 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56dd4cd66b-bks2p" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" containerID="cri-o://3895e207320bf0cbc671c4655b705500f4018eba15b4ac5b18e9ad2e8d126c44" gracePeriod=15 Jun 10 12:08:35.030513 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.030484 2576 generic.go:356] "Generic (PLEG): container finished" podID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerID="3895e207320bf0cbc671c4655b705500f4018eba15b4ac5b18e9ad2e8d126c44" exitCode=0 Jun 10 12:08:35.030667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.030549 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd4cd66b-bks2p" event={"ID":"ee3a048b-0247-4264-bc74-4a57b62e4d2a","Type":"ContainerDied","Data":"3895e207320bf0cbc671c4655b705500f4018eba15b4ac5b18e9ad2e8d126c44"} Jun 10 12:08:35.060729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.060708 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:08:35.222704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222671 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjgvh\" (UniqueName: \"kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.222863 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222717 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.222863 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222769 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.222981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222862 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.222981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222890 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.222981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.222920 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert\") pod \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\" (UID: \"ee3a048b-0247-4264-bc74-4a57b62e4d2a\") " Jun 10 12:08:35.223361 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.223176 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca" (OuterVolumeSpecName: "service-ca") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:35.223361 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.223285 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config" (OuterVolumeSpecName: "console-config") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:35.223361 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.223325 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:35.225188 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.225156 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:35.225291 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.225201 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:35.225291 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.225230 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh" (OuterVolumeSpecName: "kube-api-access-sjgvh") pod "ee3a048b-0247-4264-bc74-4a57b62e4d2a" (UID: "ee3a048b-0247-4264-bc74-4a57b62e4d2a"). InnerVolumeSpecName "kube-api-access-sjgvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:35.324047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324009 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:35.324047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324042 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-oauth-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:35.324047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324054 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:35.324281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324066 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjgvh\" (UniqueName: \"kubernetes.io/projected/ee3a048b-0247-4264-bc74-4a57b62e4d2a-kube-api-access-sjgvh\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:35.324281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324078 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ee3a048b-0247-4264-bc74-4a57b62e4d2a-service-ca\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:35.324281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:35.324090 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ee3a048b-0247-4264-bc74-4a57b62e4d2a-console-oauth-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:36.035613 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:36.035581 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56dd4cd66b-bks2p" event={"ID":"ee3a048b-0247-4264-bc74-4a57b62e4d2a","Type":"ContainerDied","Data":"c85d0a35d0576e5c3208f519e7a5ee1f081a21e600f864e84e0c6748b749a47e"} Jun 10 12:08:36.035613 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:36.035606 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56dd4cd66b-bks2p" Jun 10 12:08:36.036123 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:36.035638 2576 scope.go:117] "RemoveContainer" containerID="3895e207320bf0cbc671c4655b705500f4018eba15b4ac5b18e9ad2e8d126c44" Jun 10 12:08:36.057303 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:36.057262 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:08:36.067483 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:36.067454 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56dd4cd66b-bks2p"] Jun 10 12:08:37.898990 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:37.898957 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" path="/var/lib/kubelet/pods/ee3a048b-0247-4264-bc74-4a57b62e4d2a/volumes" Jun 10 12:08:49.060862 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.060822 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5bd74865c5-r5r92" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" containerID="cri-o://607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55" gracePeriod=15 Jun 10 12:08:49.306243 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.306220 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:08:49.329726 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329661 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.329726 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329718 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.329905 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.329905 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329803 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99dgq\" (UniqueName: \"kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.329905 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329833 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.329905 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329880 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.330145 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.329909 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config\") pod \"42a19b02-37d7-420a-a548-f0129f6f34c7\" (UID: \"42a19b02-37d7-420a-a548-f0129f6f34c7\") " Jun 10 12:08:49.330145 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.330101 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config" (OuterVolumeSpecName: "console-config") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:49.330245 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.330203 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-console-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.330455 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.330378 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:49.330551 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.330516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:49.330653 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.330628 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:49.332694 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.332666 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:49.332782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.332700 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:49.332782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.332705 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq" (OuterVolumeSpecName: "kube-api-access-99dgq") pod "42a19b02-37d7-420a-a548-f0129f6f34c7" (UID: "42a19b02-37d7-420a-a548-f0129f6f34c7"). InnerVolumeSpecName "kube-api-access-99dgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:49.431425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431388 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-trusted-ca-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.431425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431417 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-oauth-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.431425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431431 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/42a19b02-37d7-420a-a548-f0129f6f34c7-console-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.431636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431444 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-oauth-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.431636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431456 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99dgq\" (UniqueName: \"kubernetes.io/projected/42a19b02-37d7-420a-a548-f0129f6f34c7-kube-api-access-99dgq\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:49.431636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:49.431468 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/42a19b02-37d7-420a-a548-f0129f6f34c7-service-ca\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:08:50.091775 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.091744 2576 generic.go:356] "Generic (PLEG): container finished" podID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerID="607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55" exitCode=0 Jun 10 12:08:50.092199 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.091784 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bd74865c5-r5r92" Jun 10 12:08:50.092199 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.091821 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74865c5-r5r92" event={"ID":"42a19b02-37d7-420a-a548-f0129f6f34c7","Type":"ContainerDied","Data":"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55"} Jun 10 12:08:50.092199 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.091867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bd74865c5-r5r92" event={"ID":"42a19b02-37d7-420a-a548-f0129f6f34c7","Type":"ContainerDied","Data":"d8bb1ca872a71fda640cf27449130f429571bb791d0cd573c99ecb944424de86"} Jun 10 12:08:50.092199 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.091889 2576 scope.go:117] "RemoveContainer" containerID="607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55" Jun 10 12:08:50.100137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.100120 2576 scope.go:117] "RemoveContainer" containerID="607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55" Jun 10 12:08:50.100382 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:08:50.100362 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55\": container with ID starting with 607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55 not found: ID does not exist" containerID="607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55" Jun 10 12:08:50.100432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.100391 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55"} err="failed to get container status \"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55\": rpc error: code = NotFound desc = could not find container \"607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55\": container with ID starting with 607bc563f936648baa944507f801164a4ecdb768fbb3b1705cb0f5e354d16b55 not found: ID does not exist" Jun 10 12:08:50.108643 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.108613 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:08:50.112504 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:50.112484 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bd74865c5-r5r92"] Jun 10 12:08:51.899198 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:08:51.899162 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" path="/var/lib/kubelet/pods/42a19b02-37d7-420a-a548-f0129f6f34c7/volumes" Jun 10 12:13:08.939258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939217 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg"] Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939662 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939680 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939693 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939814 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee3a048b-0247-4264-bc74-4a57b62e4d2a" containerName="console" Jun 10 12:13:08.939847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.939830 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="42a19b02-37d7-420a-a548-f0129f6f34c7" containerName="console" Jun 10 12:13:08.942051 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.942030 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:08.946581 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.946561 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:13:08.947965 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.947943 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:13:08.947965 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.947955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:13:08.971043 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.970971 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg"] Jun 10 12:13:08.998583 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.998559 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:08.998705 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.998645 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxzk7\" (UniqueName: \"kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:08.998897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:08.998878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.099550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.099517 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxzk7\" (UniqueName: \"kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.099683 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.099576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.099683 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.099605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.099918 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.099903 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.099977 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.099948 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.107781 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.107759 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxzk7\" (UniqueName: \"kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.250551 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.250522 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:09.374485 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.374454 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg"] Jun 10 12:13:09.377989 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:13:09.377956 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb9d817a_7418_4430_aa01_851b002ce359.slice/crio-349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a WatchSource:0}: Error finding container 349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a: Status 404 returned error can't find the container with id 349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a Jun 10 12:13:09.379986 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:09.379969 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:13:10.085267 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:10.085235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" event={"ID":"fb9d817a-7418-4430-aa01-851b002ce359","Type":"ContainerStarted","Data":"349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a"} Jun 10 12:13:19.128443 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:19.128361 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb9d817a-7418-4430-aa01-851b002ce359" containerID="3da3284d6d2323968afee559e1b2688208f982376dbe3c7641e3e5835e4b3cd4" exitCode=0 Jun 10 12:13:19.128443 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:19.128405 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" event={"ID":"fb9d817a-7418-4430-aa01-851b002ce359","Type":"ContainerDied","Data":"3da3284d6d2323968afee559e1b2688208f982376dbe3c7641e3e5835e4b3cd4"} Jun 10 12:13:21.139118 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:21.139087 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb9d817a-7418-4430-aa01-851b002ce359" containerID="61a2be4113221633e8ce31e9103d03dc333a3dc9a57a6a128dc3f20d090d0bd1" exitCode=0 Jun 10 12:13:21.139502 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:21.139143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" event={"ID":"fb9d817a-7418-4430-aa01-851b002ce359","Type":"ContainerDied","Data":"61a2be4113221633e8ce31e9103d03dc333a3dc9a57a6a128dc3f20d090d0bd1"} Jun 10 12:13:25.871384 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:25.871353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:13:25.871831 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:25.871353 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:13:25.878503 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:25.878483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:13:25.878503 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:25.878497 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:13:29.176891 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:29.176860 2576 generic.go:356] "Generic (PLEG): container finished" podID="fb9d817a-7418-4430-aa01-851b002ce359" containerID="0e476dccbc6fa37a1435e99d0ac55d3c50fe4727a2179f04b9cc80566b9180ba" exitCode=0 Jun 10 12:13:29.177343 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:29.176966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" event={"ID":"fb9d817a-7418-4430-aa01-851b002ce359","Type":"ContainerDied","Data":"0e476dccbc6fa37a1435e99d0ac55d3c50fe4727a2179f04b9cc80566b9180ba"} Jun 10 12:13:30.352048 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.352019 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:30.395226 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.395197 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util\") pod \"fb9d817a-7418-4430-aa01-851b002ce359\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " Jun 10 12:13:30.395355 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.395241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxzk7\" (UniqueName: \"kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7\") pod \"fb9d817a-7418-4430-aa01-851b002ce359\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " Jun 10 12:13:30.395355 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.395289 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle\") pod \"fb9d817a-7418-4430-aa01-851b002ce359\" (UID: \"fb9d817a-7418-4430-aa01-851b002ce359\") " Jun 10 12:13:30.395977 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.395926 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle" (OuterVolumeSpecName: "bundle") pod "fb9d817a-7418-4430-aa01-851b002ce359" (UID: "fb9d817a-7418-4430-aa01-851b002ce359"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:13:30.397346 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.397323 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7" (OuterVolumeSpecName: "kube-api-access-fxzk7") pod "fb9d817a-7418-4430-aa01-851b002ce359" (UID: "fb9d817a-7418-4430-aa01-851b002ce359"). InnerVolumeSpecName "kube-api-access-fxzk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:13:30.399526 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.399503 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util" (OuterVolumeSpecName: "util") pod "fb9d817a-7418-4430-aa01-851b002ce359" (UID: "fb9d817a-7418-4430-aa01-851b002ce359"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:13:30.496362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.496333 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:30.496362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.496362 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fb9d817a-7418-4430-aa01-851b002ce359-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:30.496569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:30.496378 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxzk7\" (UniqueName: \"kubernetes.io/projected/fb9d817a-7418-4430-aa01-851b002ce359-kube-api-access-fxzk7\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:31.187141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:31.187114 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" Jun 10 12:13:31.187141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:31.187126 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dlqwpg" event={"ID":"fb9d817a-7418-4430-aa01-851b002ce359","Type":"ContainerDied","Data":"349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a"} Jun 10 12:13:31.187342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:31.187167 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="349bcc2ee425493637202bf723963bd292f834bb946a8615e056edce5d35343a" Jun 10 12:13:36.840438 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840403 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d"] Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840721 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="util" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840731 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="util" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840743 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="pull" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840749 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="pull" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840761 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="extract" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840767 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="extract" Jun 10 12:13:36.842135 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.840813 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fb9d817a-7418-4430-aa01-851b002ce359" containerName="extract" Jun 10 12:13:36.843084 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.843066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:36.845883 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.845837 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-g7ltt\"" Jun 10 12:13:36.845883 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.845870 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:13:36.846123 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.846105 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jun 10 12:13:36.856876 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.856852 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d"] Jun 10 12:13:36.939401 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.939367 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62751c3c-d341-4a71-9b09-97a7a69f554f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:36.939555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:36.939417 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5kgf\" (UniqueName: \"kubernetes.io/projected/62751c3c-d341-4a71-9b09-97a7a69f554f-kube-api-access-n5kgf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.040762 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.040713 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62751c3c-d341-4a71-9b09-97a7a69f554f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.040957 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.040789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5kgf\" (UniqueName: \"kubernetes.io/projected/62751c3c-d341-4a71-9b09-97a7a69f554f-kube-api-access-n5kgf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.041156 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.041133 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/62751c3c-d341-4a71-9b09-97a7a69f554f-tmp\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.062895 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.062860 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5kgf\" (UniqueName: \"kubernetes.io/projected/62751c3c-d341-4a71-9b09-97a7a69f554f-kube-api-access-n5kgf\") pod \"cert-manager-operator-controller-manager-57757f7cfc-gll8d\" (UID: \"62751c3c-d341-4a71-9b09-97a7a69f554f\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.152364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.152279 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" Jun 10 12:13:37.285445 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:37.285421 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d"] Jun 10 12:13:37.288445 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:13:37.288413 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62751c3c_d341_4a71_9b09_97a7a69f554f.slice/crio-515151414f7ee997d33c6316c44c9538675d9669934dac70a4e32098e7e9bc5b WatchSource:0}: Error finding container 515151414f7ee997d33c6316c44c9538675d9669934dac70a4e32098e7e9bc5b: Status 404 returned error can't find the container with id 515151414f7ee997d33c6316c44c9538675d9669934dac70a4e32098e7e9bc5b Jun 10 12:13:38.219691 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:38.219613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" event={"ID":"62751c3c-d341-4a71-9b09-97a7a69f554f","Type":"ContainerStarted","Data":"515151414f7ee997d33c6316c44c9538675d9669934dac70a4e32098e7e9bc5b"} Jun 10 12:13:40.234350 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:40.234317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" event={"ID":"62751c3c-d341-4a71-9b09-97a7a69f554f","Type":"ContainerStarted","Data":"ea1899191f5591ea94686854caff6dd95dbd03d72a886f45082a39fb93cd4b6c"} Jun 10 12:13:40.257515 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:40.257434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57757f7cfc-gll8d" podStartSLOduration=2.005630354 podStartE2EDuration="4.257409669s" totalImagesPullingTime="2.251779315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:13:40.25405998 +0000 UTC m=+614.842406836" watchObservedRunningTime="2026-06-10 12:13:40.257409669 +0000 UTC m=+614.845756529" Jun 10 12:13:41.176611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.176577 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb"] Jun 10 12:13:41.180313 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.180296 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.183222 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.183191 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:13:41.183325 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.183249 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:13:41.183325 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.183296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:13:41.189351 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.189322 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb"] Jun 10 12:13:41.277623 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.277588 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.278022 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.277633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.278022 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.277748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8zkr\" (UniqueName: \"kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.378847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.378809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.378983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.378871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8zkr\" (UniqueName: \"kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.378983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.378915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.379259 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.379226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.379302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.379290 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.387370 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.387344 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8zkr\" (UniqueName: \"kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.490106 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.490077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:41.617211 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:41.617188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb"] Jun 10 12:13:41.619181 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:13:41.619149 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc144308_fd6f_4c97_b240_0ef501333416.slice/crio-e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4 WatchSource:0}: Error finding container e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4: Status 404 returned error can't find the container with id e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4 Jun 10 12:13:42.246720 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:42.246689 2576 generic.go:356] "Generic (PLEG): container finished" podID="cc144308-fd6f-4c97-b240-0ef501333416" containerID="c8f4c1f1ea3271fd36fc12088d9fcbe9ebeb8a6f150351649e86d1be2cd00fe1" exitCode=0 Jun 10 12:13:42.246887 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:42.246736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" event={"ID":"cc144308-fd6f-4c97-b240-0ef501333416","Type":"ContainerDied","Data":"c8f4c1f1ea3271fd36fc12088d9fcbe9ebeb8a6f150351649e86d1be2cd00fe1"} Jun 10 12:13:42.246887 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:42.246773 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" event={"ID":"cc144308-fd6f-4c97-b240-0ef501333416","Type":"ContainerStarted","Data":"e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4"} Jun 10 12:13:44.049948 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.049909 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk"] Jun 10 12:13:44.053199 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.053182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.055951 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.055903 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 10 12:13:44.056046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.055904 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 10 12:13:44.057063 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.057025 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gwb9p\"" Jun 10 12:13:44.062545 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.062524 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk"] Jun 10 12:13:44.105125 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.105087 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclzb\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-kube-api-access-xclzb\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.105242 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.105138 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.206611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.206577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclzb\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-kube-api-access-xclzb\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.206756 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.206617 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.215190 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.215160 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.215367 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.215349 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclzb\" (UniqueName: \"kubernetes.io/projected/9893c20f-4b2b-4911-9fa3-249fab04b88e-kube-api-access-xclzb\") pod \"cert-manager-cainjector-5d99449ffd-j2rfk\" (UID: \"9893c20f-4b2b-4911-9fa3-249fab04b88e\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.371140 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.371064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" Jun 10 12:13:44.506191 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:44.506012 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk"] Jun 10 12:13:44.509418 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:13:44.509377 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9893c20f_4b2b_4911_9fa3_249fab04b88e.slice/crio-603d439c09b44b11369c4ccf15cb3fbfd63f51b4b867ec7e7657f23132d1a97b WatchSource:0}: Error finding container 603d439c09b44b11369c4ccf15cb3fbfd63f51b4b867ec7e7657f23132d1a97b: Status 404 returned error can't find the container with id 603d439c09b44b11369c4ccf15cb3fbfd63f51b4b867ec7e7657f23132d1a97b Jun 10 12:13:45.263990 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:45.263960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" event={"ID":"9893c20f-4b2b-4911-9fa3-249fab04b88e","Type":"ContainerStarted","Data":"603d439c09b44b11369c4ccf15cb3fbfd63f51b4b867ec7e7657f23132d1a97b"} Jun 10 12:13:46.270283 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:46.270248 2576 generic.go:356] "Generic (PLEG): container finished" podID="cc144308-fd6f-4c97-b240-0ef501333416" containerID="b5c9dc6a94f3b001490e9c962284a27ea95cfa2d431668708e3b289ba9120e1a" exitCode=0 Jun 10 12:13:46.270756 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:46.270335 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" event={"ID":"cc144308-fd6f-4c97-b240-0ef501333416","Type":"ContainerDied","Data":"b5c9dc6a94f3b001490e9c962284a27ea95cfa2d431668708e3b289ba9120e1a"} Jun 10 12:13:47.276357 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:47.276325 2576 generic.go:356] "Generic (PLEG): container finished" podID="cc144308-fd6f-4c97-b240-0ef501333416" containerID="040473fed3e337ccc17fd7b8676e1bff7f558e49254e4a65424695efeb04ff14" exitCode=0 Jun 10 12:13:47.276717 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:47.276373 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" event={"ID":"cc144308-fd6f-4c97-b240-0ef501333416","Type":"ContainerDied","Data":"040473fed3e337ccc17fd7b8676e1bff7f558e49254e4a65424695efeb04ff14"} Jun 10 12:13:48.423337 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.423311 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:48.542347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.542266 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle\") pod \"cc144308-fd6f-4c97-b240-0ef501333416\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " Jun 10 12:13:48.542347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.542316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k8zkr\" (UniqueName: \"kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr\") pod \"cc144308-fd6f-4c97-b240-0ef501333416\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " Jun 10 12:13:48.542347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.542344 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util\") pod \"cc144308-fd6f-4c97-b240-0ef501333416\" (UID: \"cc144308-fd6f-4c97-b240-0ef501333416\") " Jun 10 12:13:48.542723 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.542695 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle" (OuterVolumeSpecName: "bundle") pod "cc144308-fd6f-4c97-b240-0ef501333416" (UID: "cc144308-fd6f-4c97-b240-0ef501333416"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:13:48.544495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.544471 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr" (OuterVolumeSpecName: "kube-api-access-k8zkr") pod "cc144308-fd6f-4c97-b240-0ef501333416" (UID: "cc144308-fd6f-4c97-b240-0ef501333416"). InnerVolumeSpecName "kube-api-access-k8zkr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:13:48.546751 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.546733 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util" (OuterVolumeSpecName: "util") pod "cc144308-fd6f-4c97-b240-0ef501333416" (UID: "cc144308-fd6f-4c97-b240-0ef501333416"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:13:48.643543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.643513 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k8zkr\" (UniqueName: \"kubernetes.io/projected/cc144308-fd6f-4c97-b240-0ef501333416-kube-api-access-k8zkr\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:48.643543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.643542 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:48.643707 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:48.643574 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cc144308-fd6f-4c97-b240-0ef501333416-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:13:49.287637 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:49.287603 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" event={"ID":"cc144308-fd6f-4c97-b240-0ef501333416","Type":"ContainerDied","Data":"e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4"} Jun 10 12:13:49.287797 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:49.287657 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e1ebdbcc26dbe6292307ebae65331fecdf2daff94c4202e2a5faa094ea49add4" Jun 10 12:13:49.287797 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:49.287619 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fxptmb" Jun 10 12:13:50.293162 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:50.293123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" event={"ID":"9893c20f-4b2b-4911-9fa3-249fab04b88e","Type":"ContainerStarted","Data":"14d74759f0033e6f153574d1d50e437f8ab72c32cad2e5e817e4ac7644cbe413"} Jun 10 12:13:50.311034 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:50.310985 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-j2rfk" podStartSLOduration=1.208195744 podStartE2EDuration="6.310971448s" totalImagesPullingTime="5.102775704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:13:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:13:50.308614719 +0000 UTC m=+624.896961578" watchObservedRunningTime="2026-06-10 12:13:50.310971448 +0000 UTC m=+624.899318308" Jun 10 12:13:58.944486 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944445 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4"] Jun 10 12:13:58.944964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944887 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="extract" Jun 10 12:13:58.944964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944905 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="extract" Jun 10 12:13:58.944964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944919 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="pull" Jun 10 12:13:58.944964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944947 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="pull" Jun 10 12:13:58.945235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.944994 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="util" Jun 10 12:13:58.945235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.945003 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="util" Jun 10 12:13:58.945235 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:58.945089 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc144308-fd6f-4c97-b240-0ef501333416" containerName="extract" Jun 10 12:13:59.002595 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.002564 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4"] Jun 10 12:13:59.002756 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.002665 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.005580 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.005542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:13:59.005685 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.005597 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 12:13:59.006945 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.006913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rbkfg\"" Jun 10 12:13:59.131783 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.131744 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.131977 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.131803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dg5j\" (UniqueName: \"kubernetes.io/projected/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-kube-api-access-6dg5j\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.232423 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.232394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dg5j\" (UniqueName: \"kubernetes.io/projected/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-kube-api-access-6dg5j\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.232553 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.232484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.232838 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.232821 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-tmp\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.240226 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.240193 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dg5j\" (UniqueName: \"kubernetes.io/projected/b62e98a2-6f5d-4933-b5a7-a6ec51644c87-kube-api-access-6dg5j\") pod \"openshift-lws-operator-fd8ccff4c-6w7n4\" (UID: \"b62e98a2-6f5d-4933-b5a7-a6ec51644c87\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.311436 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.311396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" Jun 10 12:13:59.435973 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:13:59.435878 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4"] Jun 10 12:13:59.438185 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:13:59.438156 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb62e98a2_6f5d_4933_b5a7_a6ec51644c87.slice/crio-32ec9ea0ec0f10a9059a19c004cd9ebaebc9d6349e43e2a0243c919d478cf51f WatchSource:0}: Error finding container 32ec9ea0ec0f10a9059a19c004cd9ebaebc9d6349e43e2a0243c919d478cf51f: Status 404 returned error can't find the container with id 32ec9ea0ec0f10a9059a19c004cd9ebaebc9d6349e43e2a0243c919d478cf51f Jun 10 12:14:00.339777 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:00.339738 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" event={"ID":"b62e98a2-6f5d-4933-b5a7-a6ec51644c87","Type":"ContainerStarted","Data":"32ec9ea0ec0f10a9059a19c004cd9ebaebc9d6349e43e2a0243c919d478cf51f"} Jun 10 12:14:02.350490 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:02.350451 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" event={"ID":"b62e98a2-6f5d-4933-b5a7-a6ec51644c87","Type":"ContainerStarted","Data":"fc219571641cf3e87819a48cf910b3f117fa7f0ff8416dc8b45c4ab70dddbd92"} Jun 10 12:14:02.368709 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:02.368656 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-6w7n4" podStartSLOduration=1.878215284 podStartE2EDuration="4.368640805s" totalImagesPullingTime="2.490425521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:02.367159243 +0000 UTC m=+636.955506117" watchObservedRunningTime="2026-06-10 12:14:02.368640805 +0000 UTC m=+636.956987665" Jun 10 12:14:05.976843 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.976809 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht"] Jun 10 12:14:05.979723 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.979705 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:05.982449 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.982426 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:14:05.983874 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.983853 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:14:05.984003 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.983859 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:14:05.988141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:05.988114 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht"] Jun 10 12:14:06.094620 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.094585 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zs26t\" (UniqueName: \"kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.094786 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.094635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.094786 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.094756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.195856 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.195825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.196017 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.195871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zs26t\" (UniqueName: \"kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.196017 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.195909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.196236 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.196216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.196320 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.196303 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.204185 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.204159 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zs26t\" (UniqueName: \"kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.290044 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.289971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:06.417197 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:06.417156 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht"] Jun 10 12:14:06.418863 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:06.418838 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81e96a5_c7f5_4483_940e_e59f35cb9279.slice/crio-2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0 WatchSource:0}: Error finding container 2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0: Status 404 returned error can't find the container with id 2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0 Jun 10 12:14:07.373782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:07.373746 2576 generic.go:356] "Generic (PLEG): container finished" podID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerID="3c9286e878fe7641fa27883d724530b2e831d168405dc37b8ffc3fc8250f8ed3" exitCode=0 Jun 10 12:14:07.374259 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:07.373800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" event={"ID":"f81e96a5-c7f5-4483-940e-e59f35cb9279","Type":"ContainerDied","Data":"3c9286e878fe7641fa27883d724530b2e831d168405dc37b8ffc3fc8250f8ed3"} Jun 10 12:14:07.374259 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:07.373851 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" event={"ID":"f81e96a5-c7f5-4483-940e-e59f35cb9279","Type":"ContainerStarted","Data":"2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0"} Jun 10 12:14:08.379989 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:08.379955 2576 generic.go:356] "Generic (PLEG): container finished" podID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerID="53c719ddc056dbd72b37e59003c00755f96ef699f0537d01e1a690b01d25d83b" exitCode=0 Jun 10 12:14:08.380342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:08.380050 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" event={"ID":"f81e96a5-c7f5-4483-940e-e59f35cb9279","Type":"ContainerDied","Data":"53c719ddc056dbd72b37e59003c00755f96ef699f0537d01e1a690b01d25d83b"} Jun 10 12:14:09.387035 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:09.387000 2576 generic.go:356] "Generic (PLEG): container finished" podID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerID="798a77a4c62b0fe2c005fa8ff6ceba8420e7ea38dbb12d2a979a6b96623c94a3" exitCode=0 Jun 10 12:14:09.387466 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:09.387068 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" event={"ID":"f81e96a5-c7f5-4483-940e-e59f35cb9279","Type":"ContainerDied","Data":"798a77a4c62b0fe2c005fa8ff6ceba8420e7ea38dbb12d2a979a6b96623c94a3"} Jun 10 12:14:10.517623 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.517599 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:10.637807 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.637775 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle\") pod \"f81e96a5-c7f5-4483-940e-e59f35cb9279\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " Jun 10 12:14:10.637807 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.637813 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util\") pod \"f81e96a5-c7f5-4483-940e-e59f35cb9279\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " Jun 10 12:14:10.638078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.637849 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zs26t\" (UniqueName: \"kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t\") pod \"f81e96a5-c7f5-4483-940e-e59f35cb9279\" (UID: \"f81e96a5-c7f5-4483-940e-e59f35cb9279\") " Jun 10 12:14:10.638541 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.638516 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle" (OuterVolumeSpecName: "bundle") pod "f81e96a5-c7f5-4483-940e-e59f35cb9279" (UID: "f81e96a5-c7f5-4483-940e-e59f35cb9279"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:10.639966 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.639920 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t" (OuterVolumeSpecName: "kube-api-access-zs26t") pod "f81e96a5-c7f5-4483-940e-e59f35cb9279" (UID: "f81e96a5-c7f5-4483-940e-e59f35cb9279"). InnerVolumeSpecName "kube-api-access-zs26t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:14:10.643558 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.643512 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util" (OuterVolumeSpecName: "util") pod "f81e96a5-c7f5-4483-940e-e59f35cb9279" (UID: "f81e96a5-c7f5-4483-940e-e59f35cb9279"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:10.738667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.738631 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zs26t\" (UniqueName: \"kubernetes.io/projected/f81e96a5-c7f5-4483-940e-e59f35cb9279-kube-api-access-zs26t\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:10.738667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.738664 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:10.738854 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:10.738677 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f81e96a5-c7f5-4483-940e-e59f35cb9279-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:11.398980 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:11.398925 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" event={"ID":"f81e96a5-c7f5-4483-940e-e59f35cb9279","Type":"ContainerDied","Data":"2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0"} Jun 10 12:14:11.398980 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:11.398984 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd6xtht" Jun 10 12:14:11.399264 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:11.398996 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bece4670de929b0f54210f3f5558993c702e03980fb431e72a01395d9131fd0" Jun 10 12:14:17.490704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.490655 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7"] Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.490994 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="pull" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491005 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="pull" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491021 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="extract" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491028 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="extract" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491036 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="util" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491041 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="util" Jun 10 12:14:17.491098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.491098 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81e96a5-c7f5-4483-940e-e59f35cb9279" containerName="extract" Jun 10 12:14:17.493562 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.493542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.499192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.499163 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:14:17.499353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.499332 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x7ndf\"" Jun 10 12:14:17.499424 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.499404 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:14:17.499898 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.499858 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:14:17.500111 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.500094 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:14:17.512143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.512105 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7"] Jun 10 12:14:17.593949 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.593906 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.594089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.594008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.594089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.594065 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc7fh\" (UniqueName: \"kubernetes.io/projected/254219ff-afec-4e9c-ac5c-d050460fd456-kube-api-access-gc7fh\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.594177 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.594140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.594222 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.594173 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.694696 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.694653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.694849 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.694714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.694849 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.694804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.694849 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.694837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.695042 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.694862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc7fh\" (UniqueName: \"kubernetes.io/projected/254219ff-afec-4e9c-ac5c-d050460fd456-kube-api-access-gc7fh\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.695259 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.695234 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.697134 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.697111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/254219ff-afec-4e9c-ac5c-d050460fd456-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.697362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.697345 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.697406 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.697353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/254219ff-afec-4e9c-ac5c-d050460fd456-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.706148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.706124 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc7fh\" (UniqueName: \"kubernetes.io/projected/254219ff-afec-4e9c-ac5c-d050460fd456-kube-api-access-gc7fh\") pod \"opendatahub-operator-controller-manager-999b5c76b-chgg7\" (UID: \"254219ff-afec-4e9c-ac5c-d050460fd456\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.803207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.803121 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:17.953804 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:17.953778 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7"] Jun 10 12:14:17.955840 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:17.955819 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254219ff_afec_4e9c_ac5c_d050460fd456.slice/crio-9ab355c487439cc921bce5aad5b9d54a64c9d1125492ef04c969098509ee503e WatchSource:0}: Error finding container 9ab355c487439cc921bce5aad5b9d54a64c9d1125492ef04c969098509ee503e: Status 404 returned error can't find the container with id 9ab355c487439cc921bce5aad5b9d54a64c9d1125492ef04c969098509ee503e Jun 10 12:14:18.430613 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:18.430575 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" event={"ID":"254219ff-afec-4e9c-ac5c-d050460fd456","Type":"ContainerStarted","Data":"9ab355c487439cc921bce5aad5b9d54a64c9d1125492ef04c969098509ee503e"} Jun 10 12:14:21.453852 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:21.453776 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" event={"ID":"254219ff-afec-4e9c-ac5c-d050460fd456","Type":"ContainerStarted","Data":"cbb4869c08c08e49ad0d982f9fb95482a869d7dbb05c09dca8f84ff842002269"} Jun 10 12:14:22.461320 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:22.461290 2576 generic.go:356] "Generic (PLEG): container finished" podID="254219ff-afec-4e9c-ac5c-d050460fd456" containerID="cbb4869c08c08e49ad0d982f9fb95482a869d7dbb05c09dca8f84ff842002269" exitCode=0 Jun 10 12:14:22.461729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:22.461361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" event={"ID":"254219ff-afec-4e9c-ac5c-d050460fd456","Type":"ContainerDied","Data":"cbb4869c08c08e49ad0d982f9fb95482a869d7dbb05c09dca8f84ff842002269"} Jun 10 12:14:23.469527 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:23.469473 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" event={"ID":"254219ff-afec-4e9c-ac5c-d050460fd456","Type":"ContainerStarted","Data":"3b30a6f93e86b5d4c14a99cd220005d00cf8e7c69ce551e4374ee498493f62f2"} Jun 10 12:14:23.469910 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:23.469578 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:23.494193 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:23.494139 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" podStartSLOduration=2.037278755 podStartE2EDuration="6.494121635s" totalImagesPullingTime="3.508154911s" totalInitContainerRuntime="948.687969ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:23.492105233 +0000 UTC m=+658.080452094" watchObservedRunningTime="2026-06-10 12:14:23.494121635 +0000 UTC m=+658.082468495" Jun 10 12:14:34.476878 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:34.476837 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-chgg7" Jun 10 12:14:37.113697 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.113660 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p"] Jun 10 12:14:37.119796 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.119774 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.123974 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.123950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 12:14:37.124095 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.124050 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rhc64\"" Jun 10 12:14:37.125658 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.125612 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 12:14:37.125781 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.125669 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 12:14:37.134902 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.134868 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p"] Jun 10 12:14:37.158534 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.158503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqjg6\" (UniqueName: \"kubernetes.io/projected/3410fa14-8c10-43dd-833b-8953df2dd93e-kube-api-access-sqjg6\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.158689 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.158616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.158689 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.158668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.158817 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.158704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3410fa14-8c10-43dd-833b-8953df2dd93e-manager-config\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.259859 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.259825 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3410fa14-8c10-43dd-833b-8953df2dd93e-manager-config\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.260041 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.259898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqjg6\" (UniqueName: \"kubernetes.io/projected/3410fa14-8c10-43dd-833b-8953df2dd93e-kube-api-access-sqjg6\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.260126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.260043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.260126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.260092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.260668 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.260638 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3410fa14-8c10-43dd-833b-8953df2dd93e-manager-config\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.262856 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.262830 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.263030 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.263008 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3410fa14-8c10-43dd-833b-8953df2dd93e-cert\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.283053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.283015 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqjg6\" (UniqueName: \"kubernetes.io/projected/3410fa14-8c10-43dd-833b-8953df2dd93e-kube-api-access-sqjg6\") pod \"lws-controller-manager-dcc5f6999-8wk2p\" (UID: \"3410fa14-8c10-43dd-833b-8953df2dd93e\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.429567 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.429470 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:37.603638 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.603595 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p"] Jun 10 12:14:37.607008 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:37.606974 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3410fa14_8c10_43dd_833b_8953df2dd93e.slice/crio-87bce4df3feb9b8e0382472602a1aa92755a874a77443f9bf2ac4b6b92808c1c WatchSource:0}: Error finding container 87bce4df3feb9b8e0382472602a1aa92755a874a77443f9bf2ac4b6b92808c1c: Status 404 returned error can't find the container with id 87bce4df3feb9b8e0382472602a1aa92755a874a77443f9bf2ac4b6b92808c1c Jun 10 12:14:37.639970 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.639919 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx"] Jun 10 12:14:37.643449 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.643433 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.646729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.646704 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:14:37.646876 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.646752 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:14:37.646876 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.646759 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:14:37.655862 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.655838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx"] Jun 10 12:14:37.665209 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.665166 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.665348 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.665257 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.665420 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.665363 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gqwd\" (UniqueName: \"kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.766361 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.766328 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.766513 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.766374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gqwd\" (UniqueName: \"kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.766513 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.766431 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.766750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.766728 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.766802 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.766785 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.775333 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.775287 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gqwd\" (UniqueName: \"kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:37.953573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:37.953541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:38.120628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:38.120601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx"] Jun 10 12:14:38.122907 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:38.122869 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ba52e5_3a36_44ee_a17c_8233fe6026b1.slice/crio-a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982 WatchSource:0}: Error finding container a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982: Status 404 returned error can't find the container with id a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982 Jun 10 12:14:38.548400 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:38.548369 2576 generic.go:356] "Generic (PLEG): container finished" podID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerID="862f28304c4abcb7626af5bf79cb65db9ad52cd280c17c9fcb14e7901c0fdebf" exitCode=0 Jun 10 12:14:38.548600 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:38.548456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" event={"ID":"e0ba52e5-3a36-44ee-a17c-8233fe6026b1","Type":"ContainerDied","Data":"862f28304c4abcb7626af5bf79cb65db9ad52cd280c17c9fcb14e7901c0fdebf"} Jun 10 12:14:38.548600 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:38.548507 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" event={"ID":"e0ba52e5-3a36-44ee-a17c-8233fe6026b1","Type":"ContainerStarted","Data":"a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982"} Jun 10 12:14:38.550832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:38.550805 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" event={"ID":"3410fa14-8c10-43dd-833b-8953df2dd93e","Type":"ContainerStarted","Data":"87bce4df3feb9b8e0382472602a1aa92755a874a77443f9bf2ac4b6b92808c1c"} Jun 10 12:14:39.558682 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:39.558649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" event={"ID":"3410fa14-8c10-43dd-833b-8953df2dd93e","Type":"ContainerStarted","Data":"69dc63ee52299cbfb377190d8eea86bd730254f5181261f30edc920271a28781"} Jun 10 12:14:39.559081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:39.558734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:39.576689 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:39.576634 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" podStartSLOduration=0.69935009 podStartE2EDuration="2.576607418s" totalImagesPullingTime="1.877257328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:39.57575404 +0000 UTC m=+674.164100899" watchObservedRunningTime="2026-06-10 12:14:39.576607418 +0000 UTC m=+674.164954277" Jun 10 12:14:40.566254 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:40.566221 2576 generic.go:356] "Generic (PLEG): container finished" podID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerID="fec396a55a357f2a32d0d15a2644c70d0f80f6176acdb721b6318aa247b709d6" exitCode=0 Jun 10 12:14:40.566684 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:40.566261 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" event={"ID":"e0ba52e5-3a36-44ee-a17c-8233fe6026b1","Type":"ContainerDied","Data":"fec396a55a357f2a32d0d15a2644c70d0f80f6176acdb721b6318aa247b709d6"} Jun 10 12:14:41.574206 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:41.574164 2576 generic.go:356] "Generic (PLEG): container finished" podID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerID="7dcf9080216456d0e0365d5d639ad57476697ffd5ea4a31b13377ba2f324e03b" exitCode=0 Jun 10 12:14:41.574575 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:41.574288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" event={"ID":"e0ba52e5-3a36-44ee-a17c-8233fe6026b1","Type":"ContainerDied","Data":"7dcf9080216456d0e0365d5d639ad57476697ffd5ea4a31b13377ba2f324e03b"} Jun 10 12:14:42.708915 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.708892 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:42.814618 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.814591 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle\") pod \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " Jun 10 12:14:42.814811 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.814641 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util\") pod \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " Jun 10 12:14:42.814811 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.814673 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gqwd\" (UniqueName: \"kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd\") pod \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\" (UID: \"e0ba52e5-3a36-44ee-a17c-8233fe6026b1\") " Jun 10 12:14:42.815681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.815643 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle" (OuterVolumeSpecName: "bundle") pod "e0ba52e5-3a36-44ee-a17c-8233fe6026b1" (UID: "e0ba52e5-3a36-44ee-a17c-8233fe6026b1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:42.816969 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.816911 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd" (OuterVolumeSpecName: "kube-api-access-5gqwd") pod "e0ba52e5-3a36-44ee-a17c-8233fe6026b1" (UID: "e0ba52e5-3a36-44ee-a17c-8233fe6026b1"). InnerVolumeSpecName "kube-api-access-5gqwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:14:42.822891 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.822848 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util" (OuterVolumeSpecName: "util") pod "e0ba52e5-3a36-44ee-a17c-8233fe6026b1" (UID: "e0ba52e5-3a36-44ee-a17c-8233fe6026b1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:42.915871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.915795 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:42.915871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.915821 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:42.915871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:42.915831 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gqwd\" (UniqueName: \"kubernetes.io/projected/e0ba52e5-3a36-44ee-a17c-8233fe6026b1-kube-api-access-5gqwd\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:43.586200 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:43.586162 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" event={"ID":"e0ba52e5-3a36-44ee-a17c-8233fe6026b1","Type":"ContainerDied","Data":"a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982"} Jun 10 12:14:43.586200 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:43.586201 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab066mspx" Jun 10 12:14:43.586411 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:43.586216 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4663a9667839b80ac2a6a97c3125907970256a2023c85771be838030b9ff982" Jun 10 12:14:50.568718 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:50.568685 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8wk2p" Jun 10 12:14:52.304470 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.304432 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv"] Jun 10 12:14:52.304981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.304915 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="pull" Jun 10 12:14:52.304981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.304946 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="pull" Jun 10 12:14:52.304981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.304969 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="util" Jun 10 12:14:52.304981 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.304978 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="util" Jun 10 12:14:52.305192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.305000 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="extract" Jun 10 12:14:52.305192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.305009 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="extract" Jun 10 12:14:52.305192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.305117 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ba52e5-3a36-44ee-a17c-8233fe6026b1" containerName="extract" Jun 10 12:14:52.377988 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.377949 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv"] Jun 10 12:14:52.378141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.378079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.381804 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.381776 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:14:52.381967 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.381908 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:14:52.383197 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.383177 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:14:52.502411 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.502374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.502596 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.502497 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7jj2\" (UniqueName: \"kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.502596 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.502546 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.603604 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.603527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7jj2\" (UniqueName: \"kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.603735 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.603603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.603735 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.603655 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.604082 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.604055 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.604128 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.604069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.635797 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.635770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7jj2\" (UniqueName: \"kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.688728 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.688697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:52.841524 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:52.841479 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76a6b027_1776_43a1_adc9_1223b992b7b7.slice/crio-e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1 WatchSource:0}: Error finding container e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1: Status 404 returned error can't find the container with id e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1 Jun 10 12:14:52.845628 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:52.845604 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv"] Jun 10 12:14:53.644810 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:53.644784 2576 generic.go:356] "Generic (PLEG): container finished" podID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerID="8e58dca95afc1568b837abdaef6690e1945033bcaecb6d1d5418731f4c13de35" exitCode=0 Jun 10 12:14:53.645144 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:53.644867 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" event={"ID":"76a6b027-1776-43a1-adc9-1223b992b7b7","Type":"ContainerDied","Data":"8e58dca95afc1568b837abdaef6690e1945033bcaecb6d1d5418731f4c13de35"} Jun 10 12:14:53.645144 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:53.644915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" event={"ID":"76a6b027-1776-43a1-adc9-1223b992b7b7","Type":"ContainerStarted","Data":"e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1"} Jun 10 12:14:54.653786 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.653750 2576 generic.go:356] "Generic (PLEG): container finished" podID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerID="a08dfe17a3d4683f96b8bfc436fd1d01ad92ef2cbc3fe31ddb0b5f5182947144" exitCode=0 Jun 10 12:14:54.654258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.653810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" event={"ID":"76a6b027-1776-43a1-adc9-1223b992b7b7","Type":"ContainerDied","Data":"a08dfe17a3d4683f96b8bfc436fd1d01ad92ef2cbc3fe31ddb0b5f5182947144"} Jun 10 12:14:54.661299 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.661269 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7f895867d-6lsch"] Jun 10 12:14:54.663829 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.663811 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.668116 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.668094 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 10 12:14:54.668522 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.668503 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-w7xr6\"" Jun 10 12:14:54.684037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.684001 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f895867d-6lsch"] Jun 10 12:14:54.721350 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.721322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vghcs\" (UniqueName: \"kubernetes.io/projected/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-kube-api-access-vghcs\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.721489 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.721415 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-redirect-config\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.822404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.822358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vghcs\" (UniqueName: \"kubernetes.io/projected/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-kube-api-access-vghcs\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.822591 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.822483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-redirect-config\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.823421 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.823400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-redirect-config\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.833206 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.833174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vghcs\" (UniqueName: \"kubernetes.io/projected/4ccb7d08-9333-4c1e-addd-0a1a5a526c3d-kube-api-access-vghcs\") pod \"dashboard-redirect-7f895867d-6lsch\" (UID: \"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d\") " pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:54.998611 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:54.998580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7f895867d-6lsch" Jun 10 12:14:55.141305 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:55.141277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7f895867d-6lsch"] Jun 10 12:14:55.142338 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:14:55.142316 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ccb7d08_9333_4c1e_addd_0a1a5a526c3d.slice/crio-a6c2c8a34aaab96fa8c6597350b17d0a7c8ee66d3721d6af692fcecea7f9b9f1 WatchSource:0}: Error finding container a6c2c8a34aaab96fa8c6597350b17d0a7c8ee66d3721d6af692fcecea7f9b9f1: Status 404 returned error can't find the container with id a6c2c8a34aaab96fa8c6597350b17d0a7c8ee66d3721d6af692fcecea7f9b9f1 Jun 10 12:14:55.659805 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:55.659770 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f895867d-6lsch" event={"ID":"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d","Type":"ContainerStarted","Data":"a6c2c8a34aaab96fa8c6597350b17d0a7c8ee66d3721d6af692fcecea7f9b9f1"} Jun 10 12:14:55.662029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:55.662003 2576 generic.go:356] "Generic (PLEG): container finished" podID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerID="0c9103dfa5c69ba1c576a536a4ad382a7b1aa7defd62030c3c7be1ba581dbbf7" exitCode=0 Jun 10 12:14:55.662145 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:55.662041 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" event={"ID":"76a6b027-1776-43a1-adc9-1223b992b7b7","Type":"ContainerDied","Data":"0c9103dfa5c69ba1c576a536a4ad382a7b1aa7defd62030c3c7be1ba581dbbf7"} Jun 10 12:14:56.797805 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.797780 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:14:56.939987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.939897 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util\") pod \"76a6b027-1776-43a1-adc9-1223b992b7b7\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " Jun 10 12:14:56.939987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.939955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle\") pod \"76a6b027-1776-43a1-adc9-1223b992b7b7\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " Jun 10 12:14:56.940201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.940011 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7jj2\" (UniqueName: \"kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2\") pod \"76a6b027-1776-43a1-adc9-1223b992b7b7\" (UID: \"76a6b027-1776-43a1-adc9-1223b992b7b7\") " Jun 10 12:14:56.940918 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.940878 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle" (OuterVolumeSpecName: "bundle") pod "76a6b027-1776-43a1-adc9-1223b992b7b7" (UID: "76a6b027-1776-43a1-adc9-1223b992b7b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:56.942046 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.942025 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2" (OuterVolumeSpecName: "kube-api-access-p7jj2") pod "76a6b027-1776-43a1-adc9-1223b992b7b7" (UID: "76a6b027-1776-43a1-adc9-1223b992b7b7"). InnerVolumeSpecName "kube-api-access-p7jj2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:14:56.945166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:56.945143 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util" (OuterVolumeSpecName: "util") pod "76a6b027-1776-43a1-adc9-1223b992b7b7" (UID: "76a6b027-1776-43a1-adc9-1223b992b7b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:14:57.040845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.040811 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:57.040845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.040843 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/76a6b027-1776-43a1-adc9-1223b992b7b7-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:57.041088 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.040857 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7jj2\" (UniqueName: \"kubernetes.io/projected/76a6b027-1776-43a1-adc9-1223b992b7b7-kube-api-access-p7jj2\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:14:57.673138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.673106 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" event={"ID":"76a6b027-1776-43a1-adc9-1223b992b7b7","Type":"ContainerDied","Data":"e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1"} Jun 10 12:14:57.673306 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.673150 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e432b5fd9b4bf73f4bf436480d949ad442b31e32e95a5dbd04d05c3e2b7d6ea1" Jun 10 12:14:57.673306 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:14:57.673150 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762attrxv" Jun 10 12:15:07.950081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950047 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6"] Jun 10 12:15:07.950566 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950546 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="pull" Jun 10 12:15:07.950681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950568 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="pull" Jun 10 12:15:07.950681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950581 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="extract" Jun 10 12:15:07.950681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950590 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="extract" Jun 10 12:15:07.950681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950601 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="util" Jun 10 12:15:07.950681 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950608 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="util" Jun 10 12:15:07.950918 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.950723 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="76a6b027-1776-43a1-adc9-1223b992b7b7" containerName="extract" Jun 10 12:15:07.956805 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.956781 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:07.959984 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.959958 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:15:07.960108 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.959983 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:15:07.960108 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.960008 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-fs6sg\"" Jun 10 12:15:07.960108 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.960029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:15:07.964789 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:07.964762 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6"] Jun 10 12:15:08.147330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147368 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147473 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147714 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147714 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.147714 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.147659 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krh7g\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-kube-api-access-krh7g\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.248865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.248829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249062 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.248881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249062 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.248962 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249062 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249010 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249062 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249167 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krh7g\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-kube-api-access-krh7g\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249677 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249650 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249781 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.249896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249854 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.250004 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249975 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.250004 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.249996 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.252467 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.252433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.252763 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.252706 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.264152 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.264101 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krh7g\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-kube-api-access-krh7g\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.264540 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.264517 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44cd32f7-dad6-4949-90b1-cd597ad0bfa0-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97955hfc6\" (UID: \"44cd32f7-dad6-4949-90b1-cd597ad0bfa0\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.271256 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.271234 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:08.581846 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.581820 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6"] Jun 10 12:15:08.583238 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:08.583214 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cd32f7_dad6_4949_90b1_cd597ad0bfa0.slice/crio-1c4f0a5cdf68b6b41cae51d21b4b2ac205610057cc70225eec38dd8e66f3ac5c WatchSource:0}: Error finding container 1c4f0a5cdf68b6b41cae51d21b4b2ac205610057cc70225eec38dd8e66f3ac5c: Status 404 returned error can't find the container with id 1c4f0a5cdf68b6b41cae51d21b4b2ac205610057cc70225eec38dd8e66f3ac5c Jun 10 12:15:08.734553 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.734510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" event={"ID":"44cd32f7-dad6-4949-90b1-cd597ad0bfa0","Type":"ContainerStarted","Data":"1c4f0a5cdf68b6b41cae51d21b4b2ac205610057cc70225eec38dd8e66f3ac5c"} Jun 10 12:15:08.735993 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.735968 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7f895867d-6lsch" event={"ID":"4ccb7d08-9333-4c1e-addd-0a1a5a526c3d","Type":"ContainerStarted","Data":"a31e9c3403c82f4d6b7b9077f90c1a87bff8b283feb97e262ead98831049d89e"} Jun 10 12:15:08.753356 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:08.753317 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7f895867d-6lsch" podStartSLOduration=1.459512277 podStartE2EDuration="14.753303542s" totalImagesPullingTime="13.293791265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:08.752067846 +0000 UTC m=+703.340414707" watchObservedRunningTime="2026-06-10 12:15:08.753303542 +0000 UTC m=+703.341650398" Jun 10 12:15:11.453141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:11.453102 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:15:11.453507 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:11.453190 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:15:11.453507 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:11.453237 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:15:11.754707 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:11.754669 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" event={"ID":"44cd32f7-dad6-4949-90b1-cd597ad0bfa0","Type":"ContainerStarted","Data":"c7a3bf6cacdc9cb12e079abdd6dff0655f340312ab43ad215e311e1eed98c01c"} Jun 10 12:15:11.776253 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:11.776199 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" podStartSLOduration=1.908653827 podStartE2EDuration="4.776177153s" totalImagesPullingTime="2.867523326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:11.774382795 +0000 UTC m=+706.362729681" watchObservedRunningTime="2026-06-10 12:15:11.776177153 +0000 UTC m=+706.364524014" Jun 10 12:15:12.272039 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:12.272003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:12.276491 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:12.276468 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:12.759768 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:12.759734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:12.760708 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:12.760694 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97955hfc6" Jun 10 12:15:38.563004 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.562969 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:38.566388 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.566365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:38.569462 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.569439 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:15:38.569648 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.569627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-rmnn8\"" Jun 10 12:15:38.570814 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.570797 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:15:38.575815 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.575792 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:38.721319 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.721286 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6q8d\" (UniqueName: \"kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d\") pod \"kuadrant-operator-catalog-mmnbp\" (UID: \"c183f966-fac2-4038-9439-1817f94412a2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:38.822282 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.822202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6q8d\" (UniqueName: \"kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d\") pod \"kuadrant-operator-catalog-mmnbp\" (UID: \"c183f966-fac2-4038-9439-1817f94412a2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:38.832366 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.832333 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6q8d\" (UniqueName: \"kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d\") pod \"kuadrant-operator-catalog-mmnbp\" (UID: \"c183f966-fac2-4038-9439-1817f94412a2\") " pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:38.879406 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.879379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:38.930354 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:38.929999 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:39.009218 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.009184 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:39.012408 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:39.012376 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc183f966_fac2_4038_9439_1817f94412a2.slice/crio-eeb96562adf689714e254fe07f6b3c989dba14de7fc96aedd4a1ac3ea736fb64 WatchSource:0}: Error finding container eeb96562adf689714e254fe07f6b3c989dba14de7fc96aedd4a1ac3ea736fb64: Status 404 returned error can't find the container with id eeb96562adf689714e254fe07f6b3c989dba14de7fc96aedd4a1ac3ea736fb64 Jun 10 12:15:39.138037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.137962 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vhfv"] Jun 10 12:15:39.140922 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.140905 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:39.151162 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.149353 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vhfv"] Jun 10 12:15:39.225855 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.225828 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grf8b\" (UniqueName: \"kubernetes.io/projected/45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc-kube-api-access-grf8b\") pod \"kuadrant-operator-catalog-5vhfv\" (UID: \"45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:39.326963 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.326902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grf8b\" (UniqueName: \"kubernetes.io/projected/45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc-kube-api-access-grf8b\") pod \"kuadrant-operator-catalog-5vhfv\" (UID: \"45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:39.337252 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.337226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grf8b\" (UniqueName: \"kubernetes.io/projected/45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc-kube-api-access-grf8b\") pod \"kuadrant-operator-catalog-5vhfv\" (UID: \"45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc\") " pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:39.454004 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.453910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:39.598488 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.598462 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5vhfv"] Jun 10 12:15:39.600290 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:39.600266 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45aba94e_dd9f_4b9a_82cb_c9e4cd732ccc.slice/crio-0c4f967a507b30c34af7238bce4cd9819471bf3a63a9d0fdab0ff4c5ffbf11ed WatchSource:0}: Error finding container 0c4f967a507b30c34af7238bce4cd9819471bf3a63a9d0fdab0ff4c5ffbf11ed: Status 404 returned error can't find the container with id 0c4f967a507b30c34af7238bce4cd9819471bf3a63a9d0fdab0ff4c5ffbf11ed Jun 10 12:15:39.891498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.891456 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" event={"ID":"45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc","Type":"ContainerStarted","Data":"0c4f967a507b30c34af7238bce4cd9819471bf3a63a9d0fdab0ff4c5ffbf11ed"} Jun 10 12:15:39.892732 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:39.892706 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" event={"ID":"c183f966-fac2-4038-9439-1817f94412a2","Type":"ContainerStarted","Data":"eeb96562adf689714e254fe07f6b3c989dba14de7fc96aedd4a1ac3ea736fb64"} Jun 10 12:15:42.911433 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:42.911329 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" event={"ID":"c183f966-fac2-4038-9439-1817f94412a2","Type":"ContainerStarted","Data":"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1"} Jun 10 12:15:42.911433 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:42.911355 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" podUID="c183f966-fac2-4038-9439-1817f94412a2" containerName="registry-server" containerID="cri-o://6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1" gracePeriod=2 Jun 10 12:15:42.912876 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:42.912856 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" event={"ID":"45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc","Type":"ContainerStarted","Data":"10d69f3e9aaffd31abd2a5a46f9bfb07a70558544b3547998e0f273d32997e9b"} Jun 10 12:15:42.927922 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:42.927865 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" podStartSLOduration=1.4155067749999999 podStartE2EDuration="4.927851025s" totalImagesPullingTime="3.51234425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:15:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:42.926322981 +0000 UTC m=+737.514669843" watchObservedRunningTime="2026-06-10 12:15:42.927851025 +0000 UTC m=+737.516197884" Jun 10 12:15:42.942853 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:42.942816 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" podStartSLOduration=1.017443009 podStartE2EDuration="3.942801766s" totalImagesPullingTime="2.925358757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:15:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:15:42.9405912 +0000 UTC m=+737.528938072" watchObservedRunningTime="2026-06-10 12:15:42.942801766 +0000 UTC m=+737.531148631" Jun 10 12:15:43.155001 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.154974 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:43.264489 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.264460 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6q8d\" (UniqueName: \"kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d\") pod \"c183f966-fac2-4038-9439-1817f94412a2\" (UID: \"c183f966-fac2-4038-9439-1817f94412a2\") " Jun 10 12:15:43.266639 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.266611 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d" (OuterVolumeSpecName: "kube-api-access-j6q8d") pod "c183f966-fac2-4038-9439-1817f94412a2" (UID: "c183f966-fac2-4038-9439-1817f94412a2"). InnerVolumeSpecName "kube-api-access-j6q8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:43.366009 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.365973 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6q8d\" (UniqueName: \"kubernetes.io/projected/c183f966-fac2-4038-9439-1817f94412a2-kube-api-access-j6q8d\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:43.921792 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.921761 2576 generic.go:356] "Generic (PLEG): container finished" podID="c183f966-fac2-4038-9439-1817f94412a2" containerID="6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1" exitCode=0 Jun 10 12:15:43.922180 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.921803 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" Jun 10 12:15:43.922180 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.921843 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" event={"ID":"c183f966-fac2-4038-9439-1817f94412a2","Type":"ContainerDied","Data":"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1"} Jun 10 12:15:43.922180 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.921891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mmnbp" event={"ID":"c183f966-fac2-4038-9439-1817f94412a2","Type":"ContainerDied","Data":"eeb96562adf689714e254fe07f6b3c989dba14de7fc96aedd4a1ac3ea736fb64"} Jun 10 12:15:43.922180 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.921916 2576 scope.go:117] "RemoveContainer" containerID="6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1" Jun 10 12:15:43.931066 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.931050 2576 scope.go:117] "RemoveContainer" containerID="6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1" Jun 10 12:15:43.931316 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:15:43.931288 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1\": container with ID starting with 6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1 not found: ID does not exist" containerID="6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1" Jun 10 12:15:43.931404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.931316 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1"} err="failed to get container status \"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1\": rpc error: code = NotFound desc = could not find container \"6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1\": container with ID starting with 6a90716da40740af89f72b10c22025fb4a57225798edd3f23c16f3b9c9f51eb1 not found: ID does not exist" Jun 10 12:15:43.939018 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.938996 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:43.945175 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:43.945156 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mmnbp"] Jun 10 12:15:45.906642 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:45.906610 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c183f966-fac2-4038-9439-1817f94412a2" path="/var/lib/kubelet/pods/c183f966-fac2-4038-9439-1817f94412a2/volumes" Jun 10 12:15:49.455050 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:49.455017 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:49.455448 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:49.455092 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:49.477573 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:49.477547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:49.973325 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:49.973298 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-5vhfv" Jun 10 12:15:54.174758 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.174725 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9"] Jun 10 12:15:54.175294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.175186 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c183f966-fac2-4038-9439-1817f94412a2" containerName="registry-server" Jun 10 12:15:54.175294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.175201 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c183f966-fac2-4038-9439-1817f94412a2" containerName="registry-server" Jun 10 12:15:54.175294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.175270 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c183f966-fac2-4038-9439-1817f94412a2" containerName="registry-server" Jun 10 12:15:54.178286 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.178269 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.181039 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.181017 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pdb74\"" Jun 10 12:15:54.187007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.186986 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9"] Jun 10 12:15:54.264754 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.264719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.264911 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.264768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.264911 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.264870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhhr\" (UniqueName: \"kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.365791 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.365761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.365897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.365842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhhr\" (UniqueName: \"kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.365897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.365866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.366172 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.366154 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.366223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.366173 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.374762 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.374742 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhhr\" (UniqueName: \"kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.488565 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.488536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:54.571317 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.571286 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q"] Jun 10 12:15:54.575495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.575473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.584295 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.584269 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q"] Jun 10 12:15:54.624919 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.624893 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9"] Jun 10 12:15:54.626267 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:54.626243 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5243aacb_d852_4676_abbc_993e41f981d0.slice/crio-38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b WatchSource:0}: Error finding container 38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b: Status 404 returned error can't find the container with id 38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b Jun 10 12:15:54.668229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.668208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.668335 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.668236 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfvx\" (UniqueName: \"kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.668335 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.668277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.768908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.768837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.768908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.768871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfvx\" (UniqueName: \"kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.769090 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.768921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.769213 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.769195 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.769277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.769261 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.777637 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.777614 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfvx\" (UniqueName: \"kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.889192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.889163 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:54.976917 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.976878 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544"] Jun 10 12:15:54.980833 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.980806 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:54.981365 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.981337 2576 generic.go:356] "Generic (PLEG): container finished" podID="5243aacb-d852-4676-abbc-993e41f981d0" containerID="fc8e145081f5a2e3387201632bb81732df3655629541b642791ef8e5f8602b4a" exitCode=0 Jun 10 12:15:54.981472 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.981425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" event={"ID":"5243aacb-d852-4676-abbc-993e41f981d0","Type":"ContainerDied","Data":"fc8e145081f5a2e3387201632bb81732df3655629541b642791ef8e5f8602b4a"} Jun 10 12:15:54.981472 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.981460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" event={"ID":"5243aacb-d852-4676-abbc-993e41f981d0","Type":"ContainerStarted","Data":"38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b"} Jun 10 12:15:54.992812 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:54.992748 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544"] Jun 10 12:15:55.020987 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.020964 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q"] Jun 10 12:15:55.022306 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:55.022281 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46296c29_1471_4f78_8b07_dbaffd9e1d6e.slice/crio-9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4 WatchSource:0}: Error finding container 9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4: Status 404 returned error can't find the container with id 9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4 Jun 10 12:15:55.071762 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.071732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prch7\" (UniqueName: \"kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.071886 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.071870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.071955 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.071913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.172460 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.172424 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.172619 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.172466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.172619 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.172505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prch7\" (UniqueName: \"kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.172871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.172848 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.172871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.172865 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.181110 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.181086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prch7\" (UniqueName: \"kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.294614 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.294546 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:55.375454 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.375372 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs"] Jun 10 12:15:55.379047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.379021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.388040 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.388006 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs"] Jun 10 12:15:55.429353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.429327 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544"] Jun 10 12:15:55.430127 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:55.430101 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8c69b9_8d29_43eb_9697_6af1e36b6059.slice/crio-3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349 WatchSource:0}: Error finding container 3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349: Status 404 returned error can't find the container with id 3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349 Jun 10 12:15:55.578959 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.578865 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmjgz\" (UniqueName: \"kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.579085 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.578962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.579085 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.579080 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.679954 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.679911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmjgz\" (UniqueName: \"kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.680070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.679974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.680070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.680060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.680415 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.680396 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.680471 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.680393 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.689296 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.689275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmjgz\" (UniqueName: \"kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.702691 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.702671 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:55.830687 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.830660 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs"] Jun 10 12:15:55.832520 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:15:55.832496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod594b7f06_57bc_4289_b5ad_02a725d5fcdd.slice/crio-0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947 WatchSource:0}: Error finding container 0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947: Status 404 returned error can't find the container with id 0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947 Jun 10 12:15:55.988833 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.988804 2576 generic.go:356] "Generic (PLEG): container finished" podID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerID="3f2d51d02c040c75d63ac401ee4be450f404e5a5bf4afee23907000d1e8fe4d7" exitCode=0 Jun 10 12:15:55.989021 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.988887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" event={"ID":"594b7f06-57bc-4289-b5ad-02a725d5fcdd","Type":"ContainerDied","Data":"3f2d51d02c040c75d63ac401ee4be450f404e5a5bf4afee23907000d1e8fe4d7"} Jun 10 12:15:55.989021 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.988959 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" event={"ID":"594b7f06-57bc-4289-b5ad-02a725d5fcdd","Type":"ContainerStarted","Data":"0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947"} Jun 10 12:15:55.990470 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.990446 2576 generic.go:356] "Generic (PLEG): container finished" podID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerID="9bfe8619b0ae5cc6b8fb5bce93d689cda5242063e85012d55b3ef8e7faa2c6b4" exitCode=0 Jun 10 12:15:55.990606 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.990584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" event={"ID":"46296c29-1471-4f78-8b07-dbaffd9e1d6e","Type":"ContainerDied","Data":"9bfe8619b0ae5cc6b8fb5bce93d689cda5242063e85012d55b3ef8e7faa2c6b4"} Jun 10 12:15:55.990657 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.990630 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" event={"ID":"46296c29-1471-4f78-8b07-dbaffd9e1d6e","Type":"ContainerStarted","Data":"9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4"} Jun 10 12:15:55.992652 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.992602 2576 generic.go:356] "Generic (PLEG): container finished" podID="5243aacb-d852-4676-abbc-993e41f981d0" containerID="4f5fa9a4a5e9a55cd6c53f1d362bb11860ab591448caaee6b9a48266eceaa489" exitCode=0 Jun 10 12:15:55.992720 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.992676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" event={"ID":"5243aacb-d852-4676-abbc-993e41f981d0","Type":"ContainerDied","Data":"4f5fa9a4a5e9a55cd6c53f1d362bb11860ab591448caaee6b9a48266eceaa489"} Jun 10 12:15:55.994225 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.994201 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerID="07a80cb87ce8e06921576e91aa4f3e1cc53947ede01e71afc425d6e8904b938d" exitCode=0 Jun 10 12:15:55.994331 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.994254 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" event={"ID":"8b8c69b9-8d29-43eb-9697-6af1e36b6059","Type":"ContainerDied","Data":"07a80cb87ce8e06921576e91aa4f3e1cc53947ede01e71afc425d6e8904b938d"} Jun 10 12:15:55.994331 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:55.994286 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" event={"ID":"8b8c69b9-8d29-43eb-9697-6af1e36b6059","Type":"ContainerStarted","Data":"3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349"} Jun 10 12:15:57.003425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.003400 2576 generic.go:356] "Generic (PLEG): container finished" podID="5243aacb-d852-4676-abbc-993e41f981d0" containerID="fedc059a8389cff04ca7110c597faaf242aa25dd3869810d0d466244e8531281" exitCode=0 Jun 10 12:15:57.003747 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.003469 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" event={"ID":"5243aacb-d852-4676-abbc-993e41f981d0","Type":"ContainerDied","Data":"fedc059a8389cff04ca7110c597faaf242aa25dd3869810d0d466244e8531281"} Jun 10 12:15:57.005195 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.005172 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerID="cd71316affdd92e4e58bec410cd9fa37007c8076dbe948fea64158018ee9ca2b" exitCode=0 Jun 10 12:15:57.005296 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.005282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" event={"ID":"8b8c69b9-8d29-43eb-9697-6af1e36b6059","Type":"ContainerDied","Data":"cd71316affdd92e4e58bec410cd9fa37007c8076dbe948fea64158018ee9ca2b"} Jun 10 12:15:57.007031 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.007006 2576 generic.go:356] "Generic (PLEG): container finished" podID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerID="265fbee03b93b5d75c28119b709a34770895b5925dc8fbe8f7b38c83cc790a63" exitCode=0 Jun 10 12:15:57.007151 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.007038 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" event={"ID":"594b7f06-57bc-4289-b5ad-02a725d5fcdd","Type":"ContainerDied","Data":"265fbee03b93b5d75c28119b709a34770895b5925dc8fbe8f7b38c83cc790a63"} Jun 10 12:15:57.008862 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.008839 2576 generic.go:356] "Generic (PLEG): container finished" podID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerID="8466706d5f172daaccf0dc2097cef2666160e5d0246df642506357af9de1b507" exitCode=0 Jun 10 12:15:57.009187 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:57.008871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" event={"ID":"46296c29-1471-4f78-8b07-dbaffd9e1d6e","Type":"ContainerDied","Data":"8466706d5f172daaccf0dc2097cef2666160e5d0246df642506357af9de1b507"} Jun 10 12:15:58.016277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.016243 2576 generic.go:356] "Generic (PLEG): container finished" podID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerID="a3a2234ad37883ce6674b649f89443f55f05dc510ca6bbfab7a62754d3a225b6" exitCode=0 Jun 10 12:15:58.016673 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.016282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" event={"ID":"594b7f06-57bc-4289-b5ad-02a725d5fcdd","Type":"ContainerDied","Data":"a3a2234ad37883ce6674b649f89443f55f05dc510ca6bbfab7a62754d3a225b6"} Jun 10 12:15:58.018414 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.018390 2576 generic.go:356] "Generic (PLEG): container finished" podID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerID="f653925a11bba15644626ab4a936176b99c7eee62da249136ba2e5a363e64018" exitCode=0 Jun 10 12:15:58.018556 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.018478 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" event={"ID":"46296c29-1471-4f78-8b07-dbaffd9e1d6e","Type":"ContainerDied","Data":"f653925a11bba15644626ab4a936176b99c7eee62da249136ba2e5a363e64018"} Jun 10 12:15:58.020581 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.020559 2576 generic.go:356] "Generic (PLEG): container finished" podID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerID="10738106d9e6463a362a85f7dc6b055cacc4505db996b9bf9aa95e1827e1a1c5" exitCode=0 Jun 10 12:15:58.020668 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.020643 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" event={"ID":"8b8c69b9-8d29-43eb-9697-6af1e36b6059","Type":"ContainerDied","Data":"10738106d9e6463a362a85f7dc6b055cacc4505db996b9bf9aa95e1827e1a1c5"} Jun 10 12:15:58.153690 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.153666 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:58.201555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.201524 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle\") pod \"5243aacb-d852-4676-abbc-993e41f981d0\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " Jun 10 12:15:58.201555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.201554 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util\") pod \"5243aacb-d852-4676-abbc-993e41f981d0\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " Jun 10 12:15:58.201749 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.201626 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhhhr\" (UniqueName: \"kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr\") pod \"5243aacb-d852-4676-abbc-993e41f981d0\" (UID: \"5243aacb-d852-4676-abbc-993e41f981d0\") " Jun 10 12:15:58.202026 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.201994 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle" (OuterVolumeSpecName: "bundle") pod "5243aacb-d852-4676-abbc-993e41f981d0" (UID: "5243aacb-d852-4676-abbc-993e41f981d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:58.203770 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.203749 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr" (OuterVolumeSpecName: "kube-api-access-fhhhr") pod "5243aacb-d852-4676-abbc-993e41f981d0" (UID: "5243aacb-d852-4676-abbc-993e41f981d0"). InnerVolumeSpecName "kube-api-access-fhhhr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:58.206782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.206763 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util" (OuterVolumeSpecName: "util") pod "5243aacb-d852-4676-abbc-993e41f981d0" (UID: "5243aacb-d852-4676-abbc-993e41f981d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:58.302958 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.302859 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhhhr\" (UniqueName: \"kubernetes.io/projected/5243aacb-d852-4676-abbc-993e41f981d0-kube-api-access-fhhhr\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:58.302958 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.302889 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:58.302958 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:58.302898 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5243aacb-d852-4676-abbc-993e41f981d0-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.028469 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.028431 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" event={"ID":"5243aacb-d852-4676-abbc-993e41f981d0","Type":"ContainerDied","Data":"38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b"} Jun 10 12:15:59.028469 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.028459 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9" Jun 10 12:15:59.028918 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.028485 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="38dd5c39fb7e04c0fe18de3df810a8d36bb2140e383dc192969922819e80257b" Jun 10 12:15:59.212041 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.212018 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:15:59.214461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.214445 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:15:59.217836 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.217819 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:15:59.311215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util\") pod \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " Jun 10 12:15:59.311215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311184 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util\") pod \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " Jun 10 12:15:59.311215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle\") pod \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311230 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util\") pod \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311291 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twfvx\" (UniqueName: \"kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx\") pod \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\" (UID: \"46296c29-1471-4f78-8b07-dbaffd9e1d6e\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311350 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmjgz\" (UniqueName: \"kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz\") pod \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311372 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle\") pod \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\" (UID: \"594b7f06-57bc-4289-b5ad-02a725d5fcdd\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311419 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prch7\" (UniqueName: \"kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7\") pod \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " Jun 10 12:15:59.311461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311451 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle\") pod \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\" (UID: \"8b8c69b9-8d29-43eb-9697-6af1e36b6059\") " Jun 10 12:15:59.311808 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.311781 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle" (OuterVolumeSpecName: "bundle") pod "46296c29-1471-4f78-8b07-dbaffd9e1d6e" (UID: "46296c29-1471-4f78-8b07-dbaffd9e1d6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.312330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.312179 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle" (OuterVolumeSpecName: "bundle") pod "594b7f06-57bc-4289-b5ad-02a725d5fcdd" (UID: "594b7f06-57bc-4289-b5ad-02a725d5fcdd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.312752 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.312713 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle" (OuterVolumeSpecName: "bundle") pod "8b8c69b9-8d29-43eb-9697-6af1e36b6059" (UID: "8b8c69b9-8d29-43eb-9697-6af1e36b6059"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.313971 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.313923 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx" (OuterVolumeSpecName: "kube-api-access-twfvx") pod "46296c29-1471-4f78-8b07-dbaffd9e1d6e" (UID: "46296c29-1471-4f78-8b07-dbaffd9e1d6e"). InnerVolumeSpecName "kube-api-access-twfvx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:59.314201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.314183 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7" (OuterVolumeSpecName: "kube-api-access-prch7") pod "8b8c69b9-8d29-43eb-9697-6af1e36b6059" (UID: "8b8c69b9-8d29-43eb-9697-6af1e36b6059"). InnerVolumeSpecName "kube-api-access-prch7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:59.314439 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.314414 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz" (OuterVolumeSpecName: "kube-api-access-zmjgz") pod "594b7f06-57bc-4289-b5ad-02a725d5fcdd" (UID: "594b7f06-57bc-4289-b5ad-02a725d5fcdd"). InnerVolumeSpecName "kube-api-access-zmjgz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:15:59.316720 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.316698 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util" (OuterVolumeSpecName: "util") pod "8b8c69b9-8d29-43eb-9697-6af1e36b6059" (UID: "8b8c69b9-8d29-43eb-9697-6af1e36b6059"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.317477 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.317458 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util" (OuterVolumeSpecName: "util") pod "46296c29-1471-4f78-8b07-dbaffd9e1d6e" (UID: "46296c29-1471-4f78-8b07-dbaffd9e1d6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.317853 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.317833 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util" (OuterVolumeSpecName: "util") pod "594b7f06-57bc-4289-b5ad-02a725d5fcdd" (UID: "594b7f06-57bc-4289-b5ad-02a725d5fcdd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:15:59.413316 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413275 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twfvx\" (UniqueName: \"kubernetes.io/projected/46296c29-1471-4f78-8b07-dbaffd9e1d6e-kube-api-access-twfvx\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413316 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413312 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmjgz\" (UniqueName: \"kubernetes.io/projected/594b7f06-57bc-4289-b5ad-02a725d5fcdd-kube-api-access-zmjgz\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413316 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413323 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413333 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prch7\" (UniqueName: \"kubernetes.io/projected/8b8c69b9-8d29-43eb-9697-6af1e36b6059-kube-api-access-prch7\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413342 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413349 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8b8c69b9-8d29-43eb-9697-6af1e36b6059-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413356 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413363 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/46296c29-1471-4f78-8b07-dbaffd9e1d6e-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:15:59.413517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:15:59.413370 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/594b7f06-57bc-4289-b5ad-02a725d5fcdd-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:00.035678 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.035650 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" Jun 10 12:16:00.036148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.035684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q" event={"ID":"46296c29-1471-4f78-8b07-dbaffd9e1d6e","Type":"ContainerDied","Data":"9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4"} Jun 10 12:16:00.036148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.035735 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c0a66eb54acd660a81ebdd45575715a292aa24a815e2df65fd70b4305ada6f4" Jun 10 12:16:00.037736 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.037716 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" Jun 10 12:16:00.037883 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.037710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544" event={"ID":"8b8c69b9-8d29-43eb-9697-6af1e36b6059","Type":"ContainerDied","Data":"3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349"} Jun 10 12:16:00.037883 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.037826 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cf68c8cf7bc8c0216b72548e1b310a554bce7e34b0a156922d93f9217e7b349" Jun 10 12:16:00.039961 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.039922 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" event={"ID":"594b7f06-57bc-4289-b5ad-02a725d5fcdd","Type":"ContainerDied","Data":"0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947"} Jun 10 12:16:00.040086 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.039974 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e012ee4c6558cf5abe096d361caa1037e2b138dcedc1d49241cbcc70b388947" Jun 10 12:16:00.040086 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:00.040000 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs" Jun 10 12:16:06.189908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.189876 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g"] Jun 10 12:16:06.190269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190226 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="pull" Jun 10 12:16:06.190269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190237 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="pull" Jun 10 12:16:06.190269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190248 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="pull" Jun 10 12:16:06.190269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190253 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="pull" Jun 10 12:16:06.190269 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190268 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190273 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190280 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190286 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190294 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190299 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190305 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190310 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="util" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190315 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="pull" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190320 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="pull" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190327 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190333 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190339 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190344 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190351 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190356 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190368 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="pull" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190373 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="pull" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190379 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190383 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="extract" Jun 10 12:16:06.190432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190435 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5243aacb-d852-4676-abbc-993e41f981d0" containerName="extract" Jun 10 12:16:06.191007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190445 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="46296c29-1471-4f78-8b07-dbaffd9e1d6e" containerName="extract" Jun 10 12:16:06.191007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190451 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="594b7f06-57bc-4289-b5ad-02a725d5fcdd" containerName="extract" Jun 10 12:16:06.191007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.190458 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b8c69b9-8d29-43eb-9697-6af1e36b6059" containerName="extract" Jun 10 12:16:06.193189 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.193170 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.195955 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.195922 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7vgvq\"" Jun 10 12:16:06.207676 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.207652 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g"] Jun 10 12:16:06.276604 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.276569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.276751 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.276620 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsx5\" (UniqueName: \"kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.377223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.377182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.377223 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.377227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsx5\" (UniqueName: \"kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.377577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.377559 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.388362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.388332 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsx5\" (UniqueName: \"kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.503358 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.503312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:06.638311 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:06.638282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g"] Jun 10 12:16:06.639515 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:16:06.639489 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48569367_3ffa_491e_96d7_f90d0fba1805.slice/crio-6c1271b215f3247caf0aa5de80a565493005b63e22a0963178ac16789d0b7c18 WatchSource:0}: Error finding container 6c1271b215f3247caf0aa5de80a565493005b63e22a0963178ac16789d0b7c18: Status 404 returned error can't find the container with id 6c1271b215f3247caf0aa5de80a565493005b63e22a0963178ac16789d0b7c18 Jun 10 12:16:07.079775 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:07.079740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" event={"ID":"48569367-3ffa-491e-96d7-f90d0fba1805","Type":"ContainerStarted","Data":"6c1271b215f3247caf0aa5de80a565493005b63e22a0963178ac16789d0b7c18"} Jun 10 12:16:11.670954 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.670897 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw"] Jun 10 12:16:11.673310 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.673293 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:11.676331 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.676310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-g9qch\"" Jun 10 12:16:11.686782 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.686758 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw"] Jun 10 12:16:11.750246 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.750209 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmx4w\" (UniqueName: \"kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w\") pod \"limitador-operator-controller-manager-859d7b78bd-knbjw\" (UID: \"c9ea0580-b4d9-4ca3-9225-1af77301a298\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:11.851593 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.851556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmx4w\" (UniqueName: \"kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w\") pod \"limitador-operator-controller-manager-859d7b78bd-knbjw\" (UID: \"c9ea0580-b4d9-4ca3-9225-1af77301a298\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:11.863071 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.863039 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmx4w\" (UniqueName: \"kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w\") pod \"limitador-operator-controller-manager-859d7b78bd-knbjw\" (UID: \"c9ea0580-b4d9-4ca3-9225-1af77301a298\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:11.983872 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:11.983840 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:12.141416 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:12.141391 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw"] Jun 10 12:16:12.142460 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:16:12.142434 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ea0580_b4d9_4ca3_9225_1af77301a298.slice/crio-54349ac18b0160d12c8e9469d7708b823029f79e6e32d81207a6ef290233c41d WatchSource:0}: Error finding container 54349ac18b0160d12c8e9469d7708b823029f79e6e32d81207a6ef290233c41d: Status 404 returned error can't find the container with id 54349ac18b0160d12c8e9469d7708b823029f79e6e32d81207a6ef290233c41d Jun 10 12:16:13.131204 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:13.131164 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" event={"ID":"c9ea0580-b4d9-4ca3-9225-1af77301a298","Type":"ContainerStarted","Data":"54349ac18b0160d12c8e9469d7708b823029f79e6e32d81207a6ef290233c41d"} Jun 10 12:16:14.140815 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:14.140715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" event={"ID":"48569367-3ffa-491e-96d7-f90d0fba1805","Type":"ContainerStarted","Data":"9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341"} Jun 10 12:16:14.141216 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:14.140889 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:14.167290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:14.167221 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" podStartSLOduration=0.975661778 podStartE2EDuration="8.167199354s" totalImagesPullingTime="7.191537576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:14.162782813 +0000 UTC m=+768.751129678" watchObservedRunningTime="2026-06-10 12:16:14.167199354 +0000 UTC m=+768.755546218" Jun 10 12:16:15.152254 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:15.152123 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" event={"ID":"c9ea0580-b4d9-4ca3-9225-1af77301a298","Type":"ContainerStarted","Data":"c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef"} Jun 10 12:16:15.170446 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:15.170398 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" podStartSLOduration=1.467684611 podStartE2EDuration="4.170381105s" totalImagesPullingTime="2.702696494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:15.169111195 +0000 UTC m=+769.757458056" watchObservedRunningTime="2026-06-10 12:16:15.170381105 +0000 UTC m=+769.758727965" Jun 10 12:16:16.157863 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.157836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:16.767691 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.767655 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72"] Jun 10 12:16:16.770216 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.770193 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:16.773191 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.773169 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 10 12:16:16.773289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.773194 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pdb74\"" Jun 10 12:16:16.773289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.773260 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 10 12:16:16.782368 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.782348 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72"] Jun 10 12:16:16.899901 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.899870 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8148e258-d5ff-4489-97e0-8d9e39daa3e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:16.900049 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.900013 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pvxp\" (UniqueName: \"kubernetes.io/projected/8148e258-d5ff-4489-97e0-8d9e39daa3e5-kube-api-access-2pvxp\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:16.900088 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:16.900061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.001791 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.001754 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pvxp\" (UniqueName: \"kubernetes.io/projected/8148e258-d5ff-4489-97e0-8d9e39daa3e5-kube-api-access-2pvxp\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.002007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.001820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.002007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.001952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8148e258-d5ff-4489-97e0-8d9e39daa3e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.002711 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:17.002684 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 10 12:16:17.002890 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.002844 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/8148e258-d5ff-4489-97e0-8d9e39daa3e5-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.003004 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:17.002908 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert podName:8148e258-d5ff-4489-97e0-8d9e39daa3e5 nodeName:}" failed. No retries permitted until 2026-06-10 12:16:17.502882953 +0000 UTC m=+772.091229806 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-9gq72" (UID: "8148e258-d5ff-4489-97e0-8d9e39daa3e5") : secret "plugin-serving-cert" not found Jun 10 12:16:17.013127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.013098 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pvxp\" (UniqueName: \"kubernetes.io/projected/8148e258-d5ff-4489-97e0-8d9e39daa3e5-kube-api-access-2pvxp\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.505490 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.505453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.507779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.507754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/8148e258-d5ff-4489-97e0-8d9e39daa3e5-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-9gq72\" (UID: \"8148e258-d5ff-4489-97e0-8d9e39daa3e5\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.680383 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.680357 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" Jun 10 12:16:17.815807 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:17.815779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72"] Jun 10 12:16:17.817616 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:16:17.817577 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8148e258_d5ff_4489_97e0_8d9e39daa3e5.slice/crio-bcb1d5c70b423f6bf32f8c4c441f703bb7d4c7964c61af193b5d015841e5a9f6 WatchSource:0}: Error finding container bcb1d5c70b423f6bf32f8c4c441f703bb7d4c7964c61af193b5d015841e5a9f6: Status 404 returned error can't find the container with id bcb1d5c70b423f6bf32f8c4c441f703bb7d4c7964c61af193b5d015841e5a9f6 Jun 10 12:16:18.170619 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:18.170540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" event={"ID":"8148e258-d5ff-4489-97e0-8d9e39daa3e5","Type":"ContainerStarted","Data":"bcb1d5c70b423f6bf32f8c4c441f703bb7d4c7964c61af193b5d015841e5a9f6"} Jun 10 12:16:25.154882 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:25.154852 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:26.916555 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.916518 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g"] Jun 10 12:16:26.917027 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.916757 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" containerName="manager" containerID="cri-o://9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341" gracePeriod=2 Jun 10 12:16:26.928701 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.928674 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g"] Jun 10 12:16:26.930376 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.930335 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"48569367-3ffa-491e-96d7-f90d0fba1805\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bb94g\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:26.942178 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.942149 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw"] Jun 10 12:16:26.942468 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.942395 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" containerName="manager" containerID="cri-o://c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef" gracePeriod=2 Jun 10 12:16:26.944687 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.944664 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:26.951132 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.951098 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:26.953480 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.953451 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:26.953635 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.953617 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:26.954289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.954126 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" containerName="manager" Jun 10 12:16:26.954289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.954145 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" containerName="manager" Jun 10 12:16:26.954289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.954290 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" containerName="manager" Jun 10 12:16:26.956002 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.955972 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:26.957808 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.957760 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw"] Jun 10 12:16:26.957910 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.957862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:26.960292 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.960263 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:26.962321 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.962293 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:26.972441 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.971785 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8"] Jun 10 12:16:26.972441 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.972371 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" containerName="manager" Jun 10 12:16:26.972441 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.972387 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" containerName="manager" Jun 10 12:16:26.972661 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.972469 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" containerName="manager" Jun 10 12:16:26.976241 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.976223 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:26.976350 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.976320 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:26.988111 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.987723 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8"] Jun 10 12:16:26.988636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.988267 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:26.988636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.988320 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5skst\" (UniqueName: \"kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:26.988636 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:26.988430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgtpc\" (UniqueName: \"kubernetes.io/projected/aeac6f17-4c7b-4dbd-8a16-2e31439ce70a-kube-api-access-kgtpc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvvz8\" (UID: \"aeac6f17-4c7b-4dbd-8a16-2e31439ce70a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:26.991599 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:26.991567 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.010357 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.010328 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.089696 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.089650 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgtpc\" (UniqueName: \"kubernetes.io/projected/aeac6f17-4c7b-4dbd-8a16-2e31439ce70a-kube-api-access-kgtpc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvvz8\" (UID: \"aeac6f17-4c7b-4dbd-8a16-2e31439ce70a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:27.089875 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.089764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:27.089875 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.089801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5skst\" (UniqueName: \"kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:27.090293 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.090264 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:27.099357 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.099330 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgtpc\" (UniqueName: \"kubernetes.io/projected/aeac6f17-4c7b-4dbd-8a16-2e31439ce70a-kube-api-access-kgtpc\") pod \"limitador-operator-controller-manager-859d7b78bd-fvvz8\" (UID: \"aeac6f17-4c7b-4dbd-8a16-2e31439ce70a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:27.100061 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.100036 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5skst\" (UniqueName: \"kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qkwvg\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:27.212665 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.212633 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.215185 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.215146 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.217257 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.217222 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.228804 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.228782 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.230851 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.230828 2576 generic.go:356] "Generic (PLEG): container finished" podID="c9ea0580-b4d9-4ca3-9225-1af77301a298" containerID="c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef" exitCode=0 Jun 10 12:16:27.230983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.230866 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.230983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.230965 2576 scope.go:117] "RemoveContainer" containerID="c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef" Jun 10 12:16:27.231146 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.231116 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.232570 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.232548 2576 generic.go:356] "Generic (PLEG): container finished" podID="48569367-3ffa-491e-96d7-f90d0fba1805" containerID="9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341" exitCode=0 Jun 10 12:16:27.232651 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.232583 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.233200 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.233173 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.235259 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.235236 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.237234 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.237210 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.241468 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.241453 2576 scope.go:117] "RemoveContainer" containerID="c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef" Jun 10 12:16:27.241760 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.241734 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef\": container with ID starting with c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef not found: ID does not exist" containerID="c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef" Jun 10 12:16:27.241834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.241771 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef"} err="failed to get container status \"c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef\": rpc error: code = NotFound desc = could not find container \"c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef\": container with ID starting with c73a421979035cd220d0cf4cabf0249a7230465334e949223a5c0f9206eaedef not found: ID does not exist" Jun 10 12:16:27.241834 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.241794 2576 scope.go:117] "RemoveContainer" containerID="9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341" Jun 10 12:16:27.250869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.250845 2576 scope.go:117] "RemoveContainer" containerID="9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341" Jun 10 12:16:27.251130 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.251106 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341\": container with ID starting with 9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341 not found: ID does not exist" containerID="9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341" Jun 10 12:16:27.251220 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.251141 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341"} err="failed to get container status \"9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341\": rpc error: code = NotFound desc = could not find container \"9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341\": container with ID starting with 9decbf908450fb1d487621c64d6946f32b36a090214e1950e61cf570534fb341 not found: ID does not exist" Jun 10 12:16:27.292988 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.292953 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmx4w\" (UniqueName: \"kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w\") pod \"c9ea0580-b4d9-4ca3-9225-1af77301a298\" (UID: \"c9ea0580-b4d9-4ca3-9225-1af77301a298\") " Jun 10 12:16:27.293158 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.293004 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume\") pod \"48569367-3ffa-491e-96d7-f90d0fba1805\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " Jun 10 12:16:27.293158 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.293069 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-svsx5\" (UniqueName: \"kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5\") pod \"48569367-3ffa-491e-96d7-f90d0fba1805\" (UID: \"48569367-3ffa-491e-96d7-f90d0fba1805\") " Jun 10 12:16:27.293443 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.293415 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "48569367-3ffa-491e-96d7-f90d0fba1805" (UID: "48569367-3ffa-491e-96d7-f90d0fba1805"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:16:27.295444 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.295419 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5" (OuterVolumeSpecName: "kube-api-access-svsx5") pod "48569367-3ffa-491e-96d7-f90d0fba1805" (UID: "48569367-3ffa-491e-96d7-f90d0fba1805"). InnerVolumeSpecName "kube-api-access-svsx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:16:27.295544 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.295457 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w" (OuterVolumeSpecName: "kube-api-access-zmx4w") pod "c9ea0580-b4d9-4ca3-9225-1af77301a298" (UID: "c9ea0580-b4d9-4ca3-9225-1af77301a298"). InnerVolumeSpecName "kube-api-access-zmx4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:16:27.358608 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.358578 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:27.367052 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.367026 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:27.394864 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.394834 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmx4w\" (UniqueName: \"kubernetes.io/projected/c9ea0580-b4d9-4ca3-9225-1af77301a298-kube-api-access-zmx4w\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:27.394864 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.394865 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/48569367-3ffa-491e-96d7-f90d0fba1805-extensions-socket-volume\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:27.395109 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.394878 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-svsx5\" (UniqueName: \"kubernetes.io/projected/48569367-3ffa-491e-96d7-f90d0fba1805-kube-api-access-svsx5\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:27.534470 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.534440 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:27.536148 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:16:27.535803 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode308b18e_fd7b_4db8_b01b_c443303db1e6.slice/crio-e5582fdcf55d67142dc46723b00ff1b1390aad49d1b77777f0cfa5261da3ff6d WatchSource:0}: Error finding container e5582fdcf55d67142dc46723b00ff1b1390aad49d1b77777f0cfa5261da3ff6d: Status 404 returned error can't find the container with id e5582fdcf55d67142dc46723b00ff1b1390aad49d1b77777f0cfa5261da3ff6d Jun 10 12:16:27.549814 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.549777 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.552874 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.552846 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.555834 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.555806 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-knbjw\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-knbjw" Jun 10 12:16:27.557282 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.557259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8"] Jun 10 12:16:27.558034 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:16:27.558008 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeac6f17_4c7b_4dbd_8a16_2e31439ce70a.slice/crio-c48191840e97ff29c2c951be18d78cc3fee45a4293e2995500f3ff845d9ac6ec WatchSource:0}: Error finding container c48191840e97ff29c2c951be18d78cc3fee45a4293e2995500f3ff845d9ac6ec: Status 404 returned error can't find the container with id c48191840e97ff29c2c951be18d78cc3fee45a4293e2995500f3ff845d9ac6ec Jun 10 12:16:27.558568 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.558541 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bb94g\" is forbidden: User \"system:node:ip-10-0-143-32.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-32.ec2.internal' and this object" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bb94g" Jun 10 12:16:27.584193 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:27.584161 2576 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48569367_3ffa_491e_96d7_f90d0fba1805.slice/crio-6c1271b215f3247caf0aa5de80a565493005b63e22a0963178ac16789d0b7c18\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9ea0580_b4d9_4ca3_9225_1af77301a298.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48569367_3ffa_491e_96d7_f90d0fba1805.slice\": RecentStats: unable to find data in memory cache]" Jun 10 12:16:27.901318 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.901282 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48569367-3ffa-491e-96d7-f90d0fba1805" path="/var/lib/kubelet/pods/48569367-3ffa-491e-96d7-f90d0fba1805/volumes" Jun 10 12:16:27.901631 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:27.901617 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9ea0580-b4d9-4ca3-9225-1af77301a298" path="/var/lib/kubelet/pods/c9ea0580-b4d9-4ca3-9225-1af77301a298/volumes" Jun 10 12:16:28.241835 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.241798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" event={"ID":"aeac6f17-4c7b-4dbd-8a16-2e31439ce70a","Type":"ContainerStarted","Data":"f7153323cfd3a19af09d52d61b837b62fb0ade5c4d436790b5a841e982ff8cea"} Jun 10 12:16:28.242290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.241849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" event={"ID":"aeac6f17-4c7b-4dbd-8a16-2e31439ce70a","Type":"ContainerStarted","Data":"c48191840e97ff29c2c951be18d78cc3fee45a4293e2995500f3ff845d9ac6ec"} Jun 10 12:16:28.242290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.241922 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:28.243387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.243361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" event={"ID":"e308b18e-fd7b-4db8-b01b-c443303db1e6","Type":"ContainerStarted","Data":"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c"} Jun 10 12:16:28.243543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.243413 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:28.243543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.243433 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" event={"ID":"e308b18e-fd7b-4db8-b01b-c443303db1e6","Type":"ContainerStarted","Data":"e5582fdcf55d67142dc46723b00ff1b1390aad49d1b77777f0cfa5261da3ff6d"} Jun 10 12:16:28.265620 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.265572 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" podStartSLOduration=2.26555784 podStartE2EDuration="2.26555784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:28.263147614 +0000 UTC m=+782.851494496" watchObservedRunningTime="2026-06-10 12:16:28.26555784 +0000 UTC m=+782.853904698" Jun 10 12:16:28.285748 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:28.285690 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" podStartSLOduration=2.28567383 podStartE2EDuration="2.28567383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:28.283112367 +0000 UTC m=+782.871459227" watchObservedRunningTime="2026-06-10 12:16:28.28567383 +0000 UTC m=+782.874020689" Jun 10 12:16:39.250889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:39.250799 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-fvvz8" Jun 10 12:16:39.250889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:39.250877 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:44.350598 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:44.350558 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" event={"ID":"8148e258-d5ff-4489-97e0-8d9e39daa3e5","Type":"ContainerStarted","Data":"accb344331c2c676bd302e690d2e16494cdef4ef4ec05bcf21ed2d4f5ddbcb31"} Jun 10 12:16:44.370983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:44.370917 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-9gq72" podStartSLOduration=2.783345158 podStartE2EDuration="28.370902316s" totalImagesPullingTime="25.587557158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:44.368512562 +0000 UTC m=+798.956859433" watchObservedRunningTime="2026-06-10 12:16:44.370902316 +0000 UTC m=+798.959249174" Jun 10 12:16:45.605185 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.605151 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:45.605551 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.605392 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" podUID="e308b18e-fd7b-4db8-b01b-c443303db1e6" containerName="manager" containerID="cri-o://52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c" gracePeriod=10 Jun 10 12:16:45.887780 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.887724 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:45.968809 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.968778 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5skst\" (UniqueName: \"kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst\") pod \"e308b18e-fd7b-4db8-b01b-c443303db1e6\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " Jun 10 12:16:45.968809 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.968817 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume\") pod \"e308b18e-fd7b-4db8-b01b-c443303db1e6\" (UID: \"e308b18e-fd7b-4db8-b01b-c443303db1e6\") " Jun 10 12:16:45.969253 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.969225 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e308b18e-fd7b-4db8-b01b-c443303db1e6" (UID: "e308b18e-fd7b-4db8-b01b-c443303db1e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:16:45.970872 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:45.970850 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst" (OuterVolumeSpecName: "kube-api-access-5skst") pod "e308b18e-fd7b-4db8-b01b-c443303db1e6" (UID: "e308b18e-fd7b-4db8-b01b-c443303db1e6"). InnerVolumeSpecName "kube-api-access-5skst". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:16:46.069495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.069458 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e308b18e-fd7b-4db8-b01b-c443303db1e6-extensions-socket-volume\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:46.069495 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.069500 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5skst\" (UniqueName: \"kubernetes.io/projected/e308b18e-fd7b-4db8-b01b-c443303db1e6-kube-api-access-5skst\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:16:46.363125 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.363091 2576 generic.go:356] "Generic (PLEG): container finished" podID="e308b18e-fd7b-4db8-b01b-c443303db1e6" containerID="52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c" exitCode=0 Jun 10 12:16:46.363294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.363134 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" Jun 10 12:16:46.363294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.363158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" event={"ID":"e308b18e-fd7b-4db8-b01b-c443303db1e6","Type":"ContainerDied","Data":"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c"} Jun 10 12:16:46.363294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.363201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg" event={"ID":"e308b18e-fd7b-4db8-b01b-c443303db1e6","Type":"ContainerDied","Data":"e5582fdcf55d67142dc46723b00ff1b1390aad49d1b77777f0cfa5261da3ff6d"} Jun 10 12:16:46.363294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.363221 2576 scope.go:117] "RemoveContainer" containerID="52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c" Jun 10 12:16:46.372520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.372503 2576 scope.go:117] "RemoveContainer" containerID="52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c" Jun 10 12:16:46.372760 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:16:46.372742 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c\": container with ID starting with 52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c not found: ID does not exist" containerID="52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c" Jun 10 12:16:46.372806 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.372768 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c"} err="failed to get container status \"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c\": rpc error: code = NotFound desc = could not find container \"52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c\": container with ID starting with 52bb9f73c713439b04b1789fc76b9b22ed4e2528aa523ca309bb7790be87b14c not found: ID does not exist" Jun 10 12:16:46.389812 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.389787 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:46.392066 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:46.392047 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qkwvg"] Jun 10 12:16:47.899819 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:16:47.899785 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e308b18e-fd7b-4db8-b01b-c443303db1e6" path="/var/lib/kubelet/pods/e308b18e-fd7b-4db8-b01b-c443303db1e6/volumes" Jun 10 12:17:01.901518 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.901479 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n"] Jun 10 12:17:01.902011 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.901958 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e308b18e-fd7b-4db8-b01b-c443303db1e6" containerName="manager" Jun 10 12:17:01.902011 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.901976 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e308b18e-fd7b-4db8-b01b-c443303db1e6" containerName="manager" Jun 10 12:17:01.902143 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.902116 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e308b18e-fd7b-4db8-b01b-c443303db1e6" containerName="manager" Jun 10 12:17:01.920843 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.920805 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n"] Jun 10 12:17:01.921007 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.920945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:01.923685 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:01.923643 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-dsvqw\"" Jun 10 12:17:02.013711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.013678 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.013711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.013711 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55d6h\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-kube-api-access-55d6h\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.013916 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.013747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.013916 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.013835 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.013916 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.013862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7764dbd-f036-4341-9c8b-b94425856155-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.014070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.014007 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.014115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.014099 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.014174 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.014122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7764dbd-f036-4341-9c8b-b94425856155-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.014174 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.014158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.115665 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.115630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.115665 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.115663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7764dbd-f036-4341-9c8b-b94425856155-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.115912 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.115690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.115912 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.115730 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.116026 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.115799 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55d6h\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-kube-api-access-55d6h\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116273 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116387 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7764dbd-f036-4341-9c8b-b94425856155-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116412 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116433 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116790 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7764dbd-f036-4341-9c8b-b94425856155-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.117273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.116885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.123818 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.119490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7764dbd-f036-4341-9c8b-b94425856155-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.123818 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.123718 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7764dbd-f036-4341-9c8b-b94425856155-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.125827 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.125805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55d6h\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-kube-api-access-55d6h\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.126229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.126210 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7764dbd-f036-4341-9c8b-b94425856155-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7hl2n\" (UID: \"b7764dbd-f036-4341-9c8b-b94425856155\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.233238 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.233191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:02.370340 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.370313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n"] Jun 10 12:17:02.371430 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:17:02.371397 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7764dbd_f036_4341_9c8b_b94425856155.slice/crio-ef153e0ef35c9de3a98b25d1140f0cf08f02b2074b3f4550a607f2f172e4d84d WatchSource:0}: Error finding container ef153e0ef35c9de3a98b25d1140f0cf08f02b2074b3f4550a607f2f172e4d84d: Status 404 returned error can't find the container with id ef153e0ef35c9de3a98b25d1140f0cf08f02b2074b3f4550a607f2f172e4d84d Jun 10 12:17:02.373687 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.373653 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:17:02.373787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.373733 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:17:02.373787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.373776 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:17:02.452865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.452828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" event={"ID":"b7764dbd-f036-4341-9c8b-b94425856155","Type":"ContainerStarted","Data":"81a7c2ff033299fdec9481513357836565e532601eeeb26bcef0080ad59f735c"} Jun 10 12:17:02.453026 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.452891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" event={"ID":"b7764dbd-f036-4341-9c8b-b94425856155","Type":"ContainerStarted","Data":"ef153e0ef35c9de3a98b25d1140f0cf08f02b2074b3f4550a607f2f172e4d84d"} Jun 10 12:17:02.476392 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:02.476327 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" podStartSLOduration=1.476305305 podStartE2EDuration="1.476305305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:02.473232991 +0000 UTC m=+817.061579854" watchObservedRunningTime="2026-06-10 12:17:02.476305305 +0000 UTC m=+817.064652166" Jun 10 12:17:03.233973 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:03.233921 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:03.238666 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:03.238640 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:03.458684 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:03.458654 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:03.459619 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:03.459600 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:17:06.009466 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.009437 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:06.116096 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.116064 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:06.116262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.116183 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.116262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.116194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:06.119207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.119185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 12:17:06.256574 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.256542 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxvv\" (UniqueName: \"kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.256734 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.256610 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.358005 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.357899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxvv\" (UniqueName: \"kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.358157 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.358001 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.358641 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.358622 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.372625 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.372591 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxvv\" (UniqueName: \"kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv\") pod \"limitador-limitador-64c94fd64f-mfrd2\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.429280 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.429245 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:06.580648 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.580570 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:06.583386 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:17:06.583345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbf3dbc_aa29_4407_a8c8_3c3cd1d4ba6e.slice/crio-8bc2c1e44a13fbe9ce839f2d43fff224a185add752554f22611cd4519253fd51 WatchSource:0}: Error finding container 8bc2c1e44a13fbe9ce839f2d43fff224a185add752554f22611cd4519253fd51: Status 404 returned error can't find the container with id 8bc2c1e44a13fbe9ce839f2d43fff224a185add752554f22611cd4519253fd51 Jun 10 12:17:06.839640 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.839607 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:06.883427 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.883397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:06.883574 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.883487 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:06.886337 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:06.886313 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bdmrj\"" Jun 10 12:17:07.065333 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.065295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jf8g\" (UniqueName: \"kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g\") pod \"authorino-58cd955675-7w2sz\" (UID: \"14602fe2-4337-4459-904b-485abc5dd168\") " pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:07.165849 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.165773 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jf8g\" (UniqueName: \"kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g\") pod \"authorino-58cd955675-7w2sz\" (UID: \"14602fe2-4337-4459-904b-485abc5dd168\") " pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:07.173577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.173546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jf8g\" (UniqueName: \"kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g\") pod \"authorino-58cd955675-7w2sz\" (UID: \"14602fe2-4337-4459-904b-485abc5dd168\") " pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:07.192983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.192958 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:07.331822 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.331794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:07.333379 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:17:07.333354 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14602fe2_4337_4459_904b_485abc5dd168.slice/crio-491fdd83f688987ef2f0685b67a2a5bd123a297db8c95cb9eef7a4e095646863 WatchSource:0}: Error finding container 491fdd83f688987ef2f0685b67a2a5bd123a297db8c95cb9eef7a4e095646863: Status 404 returned error can't find the container with id 491fdd83f688987ef2f0685b67a2a5bd123a297db8c95cb9eef7a4e095646863 Jun 10 12:17:07.484672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.484631 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7w2sz" event={"ID":"14602fe2-4337-4459-904b-485abc5dd168","Type":"ContainerStarted","Data":"491fdd83f688987ef2f0685b67a2a5bd123a297db8c95cb9eef7a4e095646863"} Jun 10 12:17:07.485865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:07.485838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" event={"ID":"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e","Type":"ContainerStarted","Data":"8bc2c1e44a13fbe9ce839f2d43fff224a185add752554f22611cd4519253fd51"} Jun 10 12:17:11.621506 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:11.621461 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:13.534350 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.534314 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7w2sz" event={"ID":"14602fe2-4337-4459-904b-485abc5dd168","Type":"ContainerStarted","Data":"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898"} Jun 10 12:17:13.534807 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.534352 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-7w2sz" podUID="14602fe2-4337-4459-904b-485abc5dd168" containerName="authorino" containerID="cri-o://204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898" gracePeriod=30 Jun 10 12:17:13.535889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.535868 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" event={"ID":"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e","Type":"ContainerStarted","Data":"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae"} Jun 10 12:17:13.536018 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.536003 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:13.555026 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.554972 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-7w2sz" podStartSLOduration=1.8190391209999999 podStartE2EDuration="7.554954048s" totalImagesPullingTime="5.735914927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:13.549185703 +0000 UTC m=+828.137532562" watchObservedRunningTime="2026-06-10 12:17:13.554954048 +0000 UTC m=+828.143300907" Jun 10 12:17:13.569485 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.569445 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" podStartSLOduration=2.080101117 podStartE2EDuration="8.569429168s" totalImagesPullingTime="6.489328051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:13.566834683 +0000 UTC m=+828.155181542" watchObservedRunningTime="2026-06-10 12:17:13.569429168 +0000 UTC m=+828.157776028" Jun 10 12:17:13.811249 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.811187 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:13.824454 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.824424 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jf8g\" (UniqueName: \"kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g\") pod \"14602fe2-4337-4459-904b-485abc5dd168\" (UID: \"14602fe2-4337-4459-904b-485abc5dd168\") " Jun 10 12:17:13.826889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.826860 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g" (OuterVolumeSpecName: "kube-api-access-6jf8g") pod "14602fe2-4337-4459-904b-485abc5dd168" (UID: "14602fe2-4337-4459-904b-485abc5dd168"). InnerVolumeSpecName "kube-api-access-6jf8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:17:13.926051 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:13.926022 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jf8g\" (UniqueName: \"kubernetes.io/projected/14602fe2-4337-4459-904b-485abc5dd168-kube-api-access-6jf8g\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:14.542313 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.542281 2576 generic.go:356] "Generic (PLEG): container finished" podID="14602fe2-4337-4459-904b-485abc5dd168" containerID="204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898" exitCode=0 Jun 10 12:17:14.542750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.542319 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-7w2sz" Jun 10 12:17:14.542750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.542360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7w2sz" event={"ID":"14602fe2-4337-4459-904b-485abc5dd168","Type":"ContainerDied","Data":"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898"} Jun 10 12:17:14.542750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.542399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-7w2sz" event={"ID":"14602fe2-4337-4459-904b-485abc5dd168","Type":"ContainerDied","Data":"491fdd83f688987ef2f0685b67a2a5bd123a297db8c95cb9eef7a4e095646863"} Jun 10 12:17:14.542750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.542419 2576 scope.go:117] "RemoveContainer" containerID="204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898" Jun 10 12:17:14.551362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.551347 2576 scope.go:117] "RemoveContainer" containerID="204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898" Jun 10 12:17:14.551626 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:17:14.551605 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898\": container with ID starting with 204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898 not found: ID does not exist" containerID="204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898" Jun 10 12:17:14.551670 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.551633 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898"} err="failed to get container status \"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898\": rpc error: code = NotFound desc = could not find container \"204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898\": container with ID starting with 204c9785e5f5e0ac4953c2bd2abf04aca5ab2c69bdae4719e64a686c87e4a898 not found: ID does not exist" Jun 10 12:17:14.560668 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.560643 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:14.562897 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:14.562879 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-7w2sz"] Jun 10 12:17:15.899393 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:15.899362 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14602fe2-4337-4459-904b-485abc5dd168" path="/var/lib/kubelet/pods/14602fe2-4337-4459-904b-485abc5dd168/volumes" Jun 10 12:17:22.614388 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:22.614354 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:22.615003 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:22.614546 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" podUID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" containerName="limitador" containerID="cri-o://fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae" gracePeriod=30 Jun 10 12:17:22.616661 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:22.616628 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:23.165721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.165699 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:23.210066 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.209995 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file\") pod \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " Jun 10 12:17:23.210066 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.210057 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhxvv\" (UniqueName: \"kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv\") pod \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\" (UID: \"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e\") " Jun 10 12:17:23.210394 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.210369 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file" (OuterVolumeSpecName: "config-file") pod "4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" (UID: "4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:17:23.212017 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.211987 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv" (OuterVolumeSpecName: "kube-api-access-nhxvv") pod "4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" (UID: "4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e"). InnerVolumeSpecName "kube-api-access-nhxvv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:17:23.310762 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.310729 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-config-file\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:23.310762 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.310758 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhxvv\" (UniqueName: \"kubernetes.io/projected/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e-kube-api-access-nhxvv\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:23.594787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.594756 2576 generic.go:356] "Generic (PLEG): container finished" podID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" containerID="fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae" exitCode=0 Jun 10 12:17:23.594978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.594803 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" Jun 10 12:17:23.594978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.594812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" event={"ID":"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e","Type":"ContainerDied","Data":"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae"} Jun 10 12:17:23.594978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.594879 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-mfrd2" event={"ID":"4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e","Type":"ContainerDied","Data":"8bc2c1e44a13fbe9ce839f2d43fff224a185add752554f22611cd4519253fd51"} Jun 10 12:17:23.594978 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.594900 2576 scope.go:117] "RemoveContainer" containerID="fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae" Jun 10 12:17:23.604224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.604205 2576 scope.go:117] "RemoveContainer" containerID="fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae" Jun 10 12:17:23.604475 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:17:23.604454 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae\": container with ID starting with fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae not found: ID does not exist" containerID="fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae" Jun 10 12:17:23.604534 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.604487 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae"} err="failed to get container status \"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae\": rpc error: code = NotFound desc = could not find container \"fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae\": container with ID starting with fc8041ab2aca2c26bbc92387eafec91cf4aa6bd3479c6b1336f73a0f66001dae not found: ID does not exist" Jun 10 12:17:23.616811 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.616788 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:23.622788 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.622764 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-mfrd2"] Jun 10 12:17:23.899426 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:23.899352 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" path="/var/lib/kubelet/pods/4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e/volumes" Jun 10 12:17:27.542599 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.542565 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-2wfs6"] Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.542952 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14602fe2-4337-4459-904b-485abc5dd168" containerName="authorino" Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.542965 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14602fe2-4337-4459-904b-485abc5dd168" containerName="authorino" Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.542986 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" containerName="limitador" Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.542991 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" containerName="limitador" Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.543059 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14602fe2-4337-4459-904b-485abc5dd168" containerName="authorino" Jun 10 12:17:27.543089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.543071 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fbf3dbc-aa29-4407-a8c8-3c3cd1d4ba6e" containerName="limitador" Jun 10 12:17:27.546500 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.546480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.549277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.549258 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 10 12:17:27.555721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.555699 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2wfs6"] Jun 10 12:17:27.650207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.650175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/843e57dd-01eb-4acc-8aeb-b76675fb56ac-data\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.650358 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.650218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97jtc\" (UniqueName: \"kubernetes.io/projected/843e57dd-01eb-4acc-8aeb-b76675fb56ac-kube-api-access-97jtc\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.750991 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.750921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/843e57dd-01eb-4acc-8aeb-b76675fb56ac-data\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.751179 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.751032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97jtc\" (UniqueName: \"kubernetes.io/projected/843e57dd-01eb-4acc-8aeb-b76675fb56ac-kube-api-access-97jtc\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.751385 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.751364 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/843e57dd-01eb-4acc-8aeb-b76675fb56ac-data\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.764117 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.764085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97jtc\" (UniqueName: \"kubernetes.io/projected/843e57dd-01eb-4acc-8aeb-b76675fb56ac-kube-api-access-97jtc\") pod \"postgres-69fb4594cf-2wfs6\" (UID: \"843e57dd-01eb-4acc-8aeb-b76675fb56ac\") " pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.858311 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.858237 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:27.990087 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:27.990053 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-2wfs6"] Jun 10 12:17:27.990586 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:17:27.990557 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod843e57dd_01eb_4acc_8aeb_b76675fb56ac.slice/crio-fb3a4a8e8b61229e1cf2c8fc054827da7a180ce4a6d2e4ee933e14ddc28d6d21 WatchSource:0}: Error finding container fb3a4a8e8b61229e1cf2c8fc054827da7a180ce4a6d2e4ee933e14ddc28d6d21: Status 404 returned error can't find the container with id fb3a4a8e8b61229e1cf2c8fc054827da7a180ce4a6d2e4ee933e14ddc28d6d21 Jun 10 12:17:28.625694 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:28.625658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2wfs6" event={"ID":"843e57dd-01eb-4acc-8aeb-b76675fb56ac","Type":"ContainerStarted","Data":"fb3a4a8e8b61229e1cf2c8fc054827da7a180ce4a6d2e4ee933e14ddc28d6d21"} Jun 10 12:17:31.647667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:31.647628 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-2wfs6" event={"ID":"843e57dd-01eb-4acc-8aeb-b76675fb56ac","Type":"ContainerStarted","Data":"094987f05d128ffaf8ddcfe3b2059df54264b311072665cea95615489f2e6211"} Jun 10 12:17:31.648064 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:31.647736 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:31.668673 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:31.668609 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-2wfs6" podStartSLOduration=1.956058274 podStartE2EDuration="4.668588577s" totalImagesPullingTime="2.712530303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:31.665453996 +0000 UTC m=+846.253800855" watchObservedRunningTime="2026-06-10 12:17:31.668588577 +0000 UTC m=+846.256935440" Jun 10 12:17:37.682908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:37.682879 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-2wfs6" Jun 10 12:17:39.192865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.192828 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m"] Jun 10 12:17:39.199545 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.199528 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.203038 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.203015 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-2ndcq\"" Jun 10 12:17:39.204057 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.204031 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 10 12:17:39.204172 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.204095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 10 12:17:39.206116 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.206092 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m"] Jun 10 12:17:39.259262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.259234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw85h\" (UniqueName: \"kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.259381 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.259281 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.259381 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.259298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.359920 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.359880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.359920 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.359921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.360145 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.360079 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw85h\" (UniqueName: \"kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.360273 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.360256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.360340 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.360319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.371533 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.371504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw85h\" (UniqueName: \"kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.510220 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.510189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:39.639524 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.639495 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m"] Jun 10 12:17:39.640417 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:17:39.640385 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ababf61_44a2_420c_9207_273c76e0c0b9.slice/crio-a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da WatchSource:0}: Error finding container a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da: Status 404 returned error can't find the container with id a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da Jun 10 12:17:39.697793 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:39.697766 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerStarted","Data":"a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da"} Jun 10 12:17:40.705084 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:40.704993 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerID="ec624e28892d36ffa9db354b12620621b5216048e19e5518f0157d688cb9f28d" exitCode=0 Jun 10 12:17:40.705084 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:40.705045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerDied","Data":"ec624e28892d36ffa9db354b12620621b5216048e19e5518f0157d688cb9f28d"} Jun 10 12:17:41.712779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:41.712749 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerStarted","Data":"710ced60ed155fcf8b912b573ec34f91372aa75ae1557e479d0d31c0e82bb584"} Jun 10 12:17:42.720364 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:42.720330 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerID="710ced60ed155fcf8b912b573ec34f91372aa75ae1557e479d0d31c0e82bb584" exitCode=0 Jun 10 12:17:42.720755 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:42.720450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerDied","Data":"710ced60ed155fcf8b912b573ec34f91372aa75ae1557e479d0d31c0e82bb584"} Jun 10 12:17:43.727895 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:43.727862 2576 generic.go:356] "Generic (PLEG): container finished" podID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerID="679b88c8738fdc56a09196a177f40be131a0de89fa86572b609828c9840f594d" exitCode=0 Jun 10 12:17:43.728314 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:43.727908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerDied","Data":"679b88c8738fdc56a09196a177f40be131a0de89fa86572b609828c9840f594d"} Jun 10 12:17:44.872477 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:44.872451 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:45.013766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.013683 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle\") pod \"8ababf61-44a2-420c-9207-273c76e0c0b9\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " Jun 10 12:17:45.013766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.013738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw85h\" (UniqueName: \"kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h\") pod \"8ababf61-44a2-420c-9207-273c76e0c0b9\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " Jun 10 12:17:45.013979 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.013780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util\") pod \"8ababf61-44a2-420c-9207-273c76e0c0b9\" (UID: \"8ababf61-44a2-420c-9207-273c76e0c0b9\") " Jun 10 12:17:45.014270 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.014244 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle" (OuterVolumeSpecName: "bundle") pod "8ababf61-44a2-420c-9207-273c76e0c0b9" (UID: "8ababf61-44a2-420c-9207-273c76e0c0b9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:17:45.015884 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.015859 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h" (OuterVolumeSpecName: "kube-api-access-xw85h") pod "8ababf61-44a2-420c-9207-273c76e0c0b9" (UID: "8ababf61-44a2-420c-9207-273c76e0c0b9"). InnerVolumeSpecName "kube-api-access-xw85h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:17:45.019639 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.019615 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util" (OuterVolumeSpecName: "util") pod "8ababf61-44a2-420c-9207-273c76e0c0b9" (UID: "8ababf61-44a2-420c-9207-273c76e0c0b9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:17:45.115362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.115318 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:45.115362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.115358 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw85h\" (UniqueName: \"kubernetes.io/projected/8ababf61-44a2-420c-9207-273c76e0c0b9-kube-api-access-xw85h\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:45.115362 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.115369 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8ababf61-44a2-420c-9207-273c76e0c0b9-util\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:17:45.740856 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.740827 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" Jun 10 12:17:45.740856 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.740849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da7485zh9m" event={"ID":"8ababf61-44a2-420c-9207-273c76e0c0b9","Type":"ContainerDied","Data":"a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da"} Jun 10 12:17:45.741081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:17:45.740892 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a347278ae840462cd1e3f2b4c4bc0353b918b7756fbac8aca41636cc7481c2da" Jun 10 12:18:09.338891 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.338815 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339183 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="pull" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339196 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="pull" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339219 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="util" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339224 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="util" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339230 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="extract" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339237 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="extract" Jun 10 12:18:09.339376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.339300 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ababf61-44a2-420c-9207-273c76e0c0b9" containerName="extract" Jun 10 12:18:09.343667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.343644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:09.346442 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.346423 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jnpjt\"" Jun 10 12:18:09.346585 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.346422 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:18:09.347693 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.347672 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:18:09.347771 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.347706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:18:09.352797 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.352774 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:18:09.428624 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.428600 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftfq8\" (UniqueName: \"kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8\") pod \"maas-keycloak-0\" (UID: \"6ba2ed26-a158-45cc-8550-19e4af91417d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:09.530065 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.530031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftfq8\" (UniqueName: \"kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8\") pod \"maas-keycloak-0\" (UID: \"6ba2ed26-a158-45cc-8550-19e4af91417d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:09.539062 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.539027 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftfq8\" (UniqueName: \"kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8\") pod \"maas-keycloak-0\" (UID: \"6ba2ed26-a158-45cc-8550-19e4af91417d\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:09.679148 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.679073 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:09.814454 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.814424 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:18:09.815571 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:18:09.815549 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba2ed26_a158_45cc_8550_19e4af91417d.slice/crio-e1fec9c8543a786e76988366bdca2d33a5e7bcb82c0541cc40bbbce2ddc748fa WatchSource:0}: Error finding container e1fec9c8543a786e76988366bdca2d33a5e7bcb82c0541cc40bbbce2ddc748fa: Status 404 returned error can't find the container with id e1fec9c8543a786e76988366bdca2d33a5e7bcb82c0541cc40bbbce2ddc748fa Jun 10 12:18:09.816921 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.816901 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:18:09.874221 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:09.874194 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6ba2ed26-a158-45cc-8550-19e4af91417d","Type":"ContainerStarted","Data":"e1fec9c8543a786e76988366bdca2d33a5e7bcb82c0541cc40bbbce2ddc748fa"} Jun 10 12:18:11.002365 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.002314 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8649b67b56-dwc4d"] Jun 10 12:18:11.006609 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.006587 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.019421 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.019216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649b67b56-dwc4d"] Jun 10 12:18:11.046769 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.046735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.046915 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.046782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-oauth-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.047014 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.046987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-oauth-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.047072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.047019 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.047072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.047037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbpvj\" (UniqueName: \"kubernetes.io/projected/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-kube-api-access-zbpvj\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.047167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.047055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-service-ca\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.047167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.047121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-trusted-ca-bundle\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.148397 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.148356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-oauth-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.148577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.148403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.148577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.148525 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbpvj\" (UniqueName: \"kubernetes.io/projected/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-kube-api-access-zbpvj\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.148577 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.148569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-service-ca\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.148972 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.148919 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-trusted-ca-bundle\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.149088 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.149057 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.149149 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.149091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-oauth-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.149277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.149214 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.149277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.149232 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-service-ca\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.149747 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.149726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-trusted-ca-bundle\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.150339 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.150307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-oauth-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.151877 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.151836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-oauth-config\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.152527 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.152468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-console-serving-cert\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.160688 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.160647 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbpvj\" (UniqueName: \"kubernetes.io/projected/cc0ecb44-5ed1-4bd4-bda0-b0adae376974-kube-api-access-zbpvj\") pod \"console-8649b67b56-dwc4d\" (UID: \"cc0ecb44-5ed1-4bd4-bda0-b0adae376974\") " pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.321393 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.321301 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:11.469510 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.469474 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8649b67b56-dwc4d"] Jun 10 12:18:11.469632 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:18:11.469561 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc0ecb44_5ed1_4bd4_bda0_b0adae376974.slice/crio-04507945c8e3cd314e86365be74419aa50e9534992c31c789304443d7c3c7541 WatchSource:0}: Error finding container 04507945c8e3cd314e86365be74419aa50e9534992c31c789304443d7c3c7541: Status 404 returned error can't find the container with id 04507945c8e3cd314e86365be74419aa50e9534992c31c789304443d7c3c7541 Jun 10 12:18:11.889073 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.889037 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649b67b56-dwc4d" event={"ID":"cc0ecb44-5ed1-4bd4-bda0-b0adae376974","Type":"ContainerStarted","Data":"d5e11584d3333b8b15f9a9713b2293ed80d21b8fd092f3d5e572a89dbc626e59"} Jun 10 12:18:11.889280 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.889095 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8649b67b56-dwc4d" event={"ID":"cc0ecb44-5ed1-4bd4-bda0-b0adae376974","Type":"ContainerStarted","Data":"04507945c8e3cd314e86365be74419aa50e9534992c31c789304443d7c3c7541"} Jun 10 12:18:11.910200 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:11.910140 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8649b67b56-dwc4d" podStartSLOduration=1.9101205289999998 podStartE2EDuration="1.910120529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:11.908196986 +0000 UTC m=+886.496543846" watchObservedRunningTime="2026-06-10 12:18:11.910120529 +0000 UTC m=+886.498467391" Jun 10 12:18:16.924248 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:16.924211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6ba2ed26-a158-45cc-8550-19e4af91417d","Type":"ContainerStarted","Data":"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958"} Jun 10 12:18:17.680255 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:17.680166 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:17.681486 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:17.681452 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:18.679553 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:18.679508 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:19.679593 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:19.679547 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:19.680122 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:19.679967 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:20.679565 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:20.679509 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:21.324357 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.324315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:21.325180 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.325151 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:21.331187 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.331156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:21.352879 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.352820 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=6.08522215 podStartE2EDuration="12.352798997s" totalImagesPullingTime="6.267576847s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:16.943969146 +0000 UTC m=+891.532316005" watchObservedRunningTime="2026-06-10 12:18:21.352798997 +0000 UTC m=+895.941145860" Jun 10 12:18:21.680268 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.680156 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:21.974309 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:21.974278 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8649b67b56-dwc4d" Jun 10 12:18:22.044018 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:22.043423 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:18:22.683530 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:22.683006 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:23.680543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:23.680494 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:24.679678 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:24.679632 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:25.680229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:25.680186 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:25.935635 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:25.935548 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:18:25.937087 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:25.937064 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:18:25.943894 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:25.943864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:18:25.946003 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:25.945967 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:18:26.680496 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:26.680444 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:27.680396 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:27.680348 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:28.679753 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:28.679699 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.53:9000/health/started\": dial tcp 10.134.0.53:9000: connect: connection refused" Jun 10 12:18:29.799908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:29.799868 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:29.817872 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:29.817808 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:18:39.804867 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:39.804828 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:18:45.971881 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.971846 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:18:45.975494 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.975471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:45.980165 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.980138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 12:18:45.980302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.980209 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 12:18:45.980302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.980143 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-krqrk\"" Jun 10 12:18:45.990374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:45.990340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:18:46.106627 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.106599 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.106825 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.106754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8n2r\" (UniqueName: \"kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.195192 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.195150 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:18:46.198714 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.198695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.207687 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.207663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8n2r\" (UniqueName: \"kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.207800 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.207772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.209948 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.209914 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:18:46.210342 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.210323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.219037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.219007 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8n2r\" (UniqueName: \"kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r\") pod \"maas-controller-6fc87ccc75-798cw\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.286760 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.286685 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:46.309082 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.309055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.309197 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.309095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9t9z\" (UniqueName: \"kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.410016 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.409987 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.410164 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.410028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9t9z\" (UniqueName: \"kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.412363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.412339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.418547 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.418523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9t9z\" (UniqueName: \"kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z\") pod \"maas-controller-c96c4f8d7-b7mdp\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.426056 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.426037 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:18:46.426579 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:18:46.426555 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14ee785d_5b3b_4423_b281_6779cd87a891.slice/crio-55ffaaa71129dab31e4be29a3350c1d1ef9e490178dc343f69e3852c93bd95b5 WatchSource:0}: Error finding container 55ffaaa71129dab31e4be29a3350c1d1ef9e490178dc343f69e3852c93bd95b5: Status 404 returned error can't find the container with id 55ffaaa71129dab31e4be29a3350c1d1ef9e490178dc343f69e3852c93bd95b5 Jun 10 12:18:46.510402 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.510377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:46.646864 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:46.646837 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:18:46.647651 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:18:46.647617 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fe4410b_e386_47ea_aec0_63c3066ad59a.slice/crio-69b640373e3bb7f2bcdb93a258167af7401e652a137fd2eced4f2ede17c34ae4 WatchSource:0}: Error finding container 69b640373e3bb7f2bcdb93a258167af7401e652a137fd2eced4f2ede17c34ae4: Status 404 returned error can't find the container with id 69b640373e3bb7f2bcdb93a258167af7401e652a137fd2eced4f2ede17c34ae4 Jun 10 12:18:47.077705 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.077519 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-869ffb8b84-z7r8j" podUID="1e3d6469-d119-4f3a-bdb9-796868e4c626" containerName="console" containerID="cri-o://45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d" gracePeriod=15 Jun 10 12:18:47.148405 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.148366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fc87ccc75-798cw" event={"ID":"14ee785d-5b3b-4423-b281-6779cd87a891","Type":"ContainerStarted","Data":"55ffaaa71129dab31e4be29a3350c1d1ef9e490178dc343f69e3852c93bd95b5"} Jun 10 12:18:47.151072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.151042 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" event={"ID":"0fe4410b-e386-47ea-aec0-63c3066ad59a","Type":"ContainerStarted","Data":"69b640373e3bb7f2bcdb93a258167af7401e652a137fd2eced4f2ede17c34ae4"} Jun 10 12:18:47.407285 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.406973 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:18:47.522177 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522143 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4fgf\" (UniqueName: \"kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522243 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522284 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522312 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522350 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522564 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522378 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.522564 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.522406 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle\") pod \"1e3d6469-d119-4f3a-bdb9-796868e4c626\" (UID: \"1e3d6469-d119-4f3a-bdb9-796868e4c626\") " Jun 10 12:18:47.524434 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.523369 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config" (OuterVolumeSpecName: "console-config") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:18:47.524434 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.523424 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:18:47.524434 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.523754 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca" (OuterVolumeSpecName: "service-ca") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:18:47.524434 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.523771 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:18:47.525452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.525425 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:18:47.527734 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.527706 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:18:47.536824 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.536782 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf" (OuterVolumeSpecName: "kube-api-access-f4fgf") pod "1e3d6469-d119-4f3a-bdb9-796868e4c626" (UID: "1e3d6469-d119-4f3a-bdb9-796868e4c626"). InnerVolumeSpecName "kube-api-access-f4fgf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:18:47.623781 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623749 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-oauth-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.623781 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623785 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-oauth-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.624078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623801 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-serving-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.624078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623814 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-service-ca\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.624078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623856 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-console-config\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.624078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623872 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e3d6469-d119-4f3a-bdb9-796868e4c626-trusted-ca-bundle\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:47.624078 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:47.623885 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4fgf\" (UniqueName: \"kubernetes.io/projected/1e3d6469-d119-4f3a-bdb9-796868e4c626-kube-api-access-f4fgf\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:18:48.159829 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.159788 2576 generic.go:356] "Generic (PLEG): container finished" podID="1e3d6469-d119-4f3a-bdb9-796868e4c626" containerID="45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d" exitCode=0 Jun 10 12:18:48.160302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.159915 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-869ffb8b84-z7r8j" Jun 10 12:18:48.160302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.159948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869ffb8b84-z7r8j" event={"ID":"1e3d6469-d119-4f3a-bdb9-796868e4c626","Type":"ContainerDied","Data":"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d"} Jun 10 12:18:48.160302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.160014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-869ffb8b84-z7r8j" event={"ID":"1e3d6469-d119-4f3a-bdb9-796868e4c626","Type":"ContainerDied","Data":"dfa4d7048da50c4512b75e0682b8b2d68c6826a387fb224867c4d5fbce710b40"} Jun 10 12:18:48.160302 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.160042 2576 scope.go:117] "RemoveContainer" containerID="45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d" Jun 10 12:18:48.182035 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.181950 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:18:48.185147 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.185125 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-869ffb8b84-z7r8j"] Jun 10 12:18:48.646229 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.645974 2576 scope.go:117] "RemoveContainer" containerID="45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d" Jun 10 12:18:48.646335 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:18:48.646312 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d\": container with ID starting with 45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d not found: ID does not exist" containerID="45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d" Jun 10 12:18:48.646375 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:48.646348 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d"} err="failed to get container status \"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d\": rpc error: code = NotFound desc = could not find container \"45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d\": container with ID starting with 45a302ca9dfefeaa9e01917bec19e97a125a80b5e31e63b1c5414c482b624f8d not found: ID does not exist" Jun 10 12:18:49.900735 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:49.900705 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e3d6469-d119-4f3a-bdb9-796868e4c626" path="/var/lib/kubelet/pods/1e3d6469-d119-4f3a-bdb9-796868e4c626/volumes" Jun 10 12:18:50.175037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.174918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" event={"ID":"0fe4410b-e386-47ea-aec0-63c3066ad59a","Type":"ContainerStarted","Data":"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc"} Jun 10 12:18:50.175037 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.174997 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:18:50.176579 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.176552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fc87ccc75-798cw" event={"ID":"14ee785d-5b3b-4423-b281-6779cd87a891","Type":"ContainerStarted","Data":"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2"} Jun 10 12:18:50.176699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.176641 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:18:50.193042 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.192994 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" podStartSLOduration=1.663946537 podStartE2EDuration="4.19297663s" totalImagesPullingTime="2.529030093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:50.19190643 +0000 UTC m=+924.780253301" watchObservedRunningTime="2026-06-10 12:18:50.19297663 +0000 UTC m=+924.781323490" Jun 10 12:18:50.218196 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:18:50.218154 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6fc87ccc75-798cw" podStartSLOduration=2.479739015 podStartE2EDuration="5.218140773s" totalImagesPullingTime="2.738401758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:50.216518453 +0000 UTC m=+924.804865315" watchObservedRunningTime="2026-06-10 12:18:50.218140773 +0000 UTC m=+924.806487662" Jun 10 12:19:01.188047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.188015 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:19:01.188432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.188239 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:19:01.238233 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.238206 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:19:01.242184 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.242148 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6fc87ccc75-798cw" podUID="14ee785d-5b3b-4423-b281-6779cd87a891" containerName="manager" containerID="cri-o://c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2" gracePeriod=30 Jun 10 12:19:01.487916 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.487896 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:19:01.660081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.660047 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert\") pod \"14ee785d-5b3b-4423-b281-6779cd87a891\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " Jun 10 12:19:01.660251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.660146 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8n2r\" (UniqueName: \"kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r\") pod \"14ee785d-5b3b-4423-b281-6779cd87a891\" (UID: \"14ee785d-5b3b-4423-b281-6779cd87a891\") " Jun 10 12:19:01.662208 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.662176 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r" (OuterVolumeSpecName: "kube-api-access-f8n2r") pod "14ee785d-5b3b-4423-b281-6779cd87a891" (UID: "14ee785d-5b3b-4423-b281-6779cd87a891"). InnerVolumeSpecName "kube-api-access-f8n2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:19:01.662322 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.662253 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "14ee785d-5b3b-4423-b281-6779cd87a891" (UID: "14ee785d-5b3b-4423-b281-6779cd87a891"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:19:01.761668 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.761594 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8n2r\" (UniqueName: \"kubernetes.io/projected/14ee785d-5b3b-4423-b281-6779cd87a891-kube-api-access-f8n2r\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:19:01.761668 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:01.761620 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/14ee785d-5b3b-4423-b281-6779cd87a891-webhook-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:19:02.249723 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.249695 2576 generic.go:356] "Generic (PLEG): container finished" podID="14ee785d-5b3b-4423-b281-6779cd87a891" containerID="c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2" exitCode=0 Jun 10 12:19:02.250166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.249741 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6fc87ccc75-798cw" Jun 10 12:19:02.250166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.249763 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fc87ccc75-798cw" event={"ID":"14ee785d-5b3b-4423-b281-6779cd87a891","Type":"ContainerDied","Data":"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2"} Jun 10 12:19:02.250166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.249803 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6fc87ccc75-798cw" event={"ID":"14ee785d-5b3b-4423-b281-6779cd87a891","Type":"ContainerDied","Data":"55ffaaa71129dab31e4be29a3350c1d1ef9e490178dc343f69e3852c93bd95b5"} Jun 10 12:19:02.250166 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.249824 2576 scope.go:117] "RemoveContainer" containerID="c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2" Jun 10 12:19:02.258983 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.258967 2576 scope.go:117] "RemoveContainer" containerID="c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2" Jun 10 12:19:02.259223 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:19:02.259206 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2\": container with ID starting with c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2 not found: ID does not exist" containerID="c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2" Jun 10 12:19:02.259262 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.259231 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2"} err="failed to get container status \"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2\": rpc error: code = NotFound desc = could not find container \"c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2\": container with ID starting with c8f78619ec891e0ef23e270e1d894438cfe38aba1f1ff2a37cec3002886309e2 not found: ID does not exist" Jun 10 12:19:02.268651 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.268628 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:19:02.272207 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:02.272186 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6fc87ccc75-798cw"] Jun 10 12:19:03.900164 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:03.900135 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14ee785d-5b3b-4423-b281-6779cd87a891" path="/var/lib/kubelet/pods/14ee785d-5b3b-4423-b281-6779cd87a891/volumes" Jun 10 12:19:20.307560 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.307512 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-596bd99fdd-9bf9l"] Jun 10 12:19:20.308072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308045 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e3d6469-d119-4f3a-bdb9-796868e4c626" containerName="console" Jun 10 12:19:20.308072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308074 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3d6469-d119-4f3a-bdb9-796868e4c626" containerName="console" Jun 10 12:19:20.308241 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308092 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14ee785d-5b3b-4423-b281-6779cd87a891" containerName="manager" Jun 10 12:19:20.308241 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308099 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14ee785d-5b3b-4423-b281-6779cd87a891" containerName="manager" Jun 10 12:19:20.308241 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308227 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e3d6469-d119-4f3a-bdb9-796868e4c626" containerName="console" Jun 10 12:19:20.308355 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.308243 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14ee785d-5b3b-4423-b281-6779cd87a891" containerName="manager" Jun 10 12:19:20.311517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.311500 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.314149 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.314126 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 10 12:19:20.314244 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.314138 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tz78\"" Jun 10 12:19:20.323709 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.323684 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-596bd99fdd-9bf9l"] Jun 10 12:19:20.426400 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.426361 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tgq9\" (UniqueName: \"kubernetes.io/projected/083853e9-9503-44aa-9efa-dc1741eb1c1b-kube-api-access-6tgq9\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.426580 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.426446 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/083853e9-9503-44aa-9efa-dc1741eb1c1b-maas-api-tls\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.527372 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.527338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/083853e9-9503-44aa-9efa-dc1741eb1c1b-maas-api-tls\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.527530 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.527430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tgq9\" (UniqueName: \"kubernetes.io/projected/083853e9-9503-44aa-9efa-dc1741eb1c1b-kube-api-access-6tgq9\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.529847 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.529818 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/083853e9-9503-44aa-9efa-dc1741eb1c1b-maas-api-tls\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.535505 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.535480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tgq9\" (UniqueName: \"kubernetes.io/projected/083853e9-9503-44aa-9efa-dc1741eb1c1b-kube-api-access-6tgq9\") pod \"maas-api-596bd99fdd-9bf9l\" (UID: \"083853e9-9503-44aa-9efa-dc1741eb1c1b\") " pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.623576 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.623496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:20.767703 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.767673 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-596bd99fdd-9bf9l"] Jun 10 12:19:20.768333 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:19:20.768308 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod083853e9_9503_44aa_9efa_dc1741eb1c1b.slice/crio-a799881aaed581f5d5b2942ebc85f56ced9a41bc7fb0fce21a6c31cfc019a822 WatchSource:0}: Error finding container a799881aaed581f5d5b2942ebc85f56ced9a41bc7fb0fce21a6c31cfc019a822: Status 404 returned error can't find the container with id a799881aaed581f5d5b2942ebc85f56ced9a41bc7fb0fce21a6c31cfc019a822 Jun 10 12:19:20.810857 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.810829 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7p7h4"] Jun 10 12:19:20.815353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.815334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:20.818076 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.818056 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 10 12:19:20.818159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.818058 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pnf5f\"" Jun 10 12:19:20.825357 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.825333 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7p7h4"] Jun 10 12:19:20.835428 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.835405 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-hrcmd"] Jun 10 12:19:20.839434 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.839414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:20.849884 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.849860 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-hrcmd"] Jun 10 12:19:20.932073 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.931993 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phzgc\" (UniqueName: \"kubernetes.io/projected/5d458b4e-3ba3-4454-9cd0-c53c6d09534c-kube-api-access-phzgc\") pod \"payload-processing-699b6cd6c-hrcmd\" (UID: \"5d458b4e-3ba3-4454-9cd0-c53c6d09534c\") " pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:20.932242 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:20.932084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9v95\" (UniqueName: \"kubernetes.io/projected/d4481fc0-c19d-410e-87c5-bd4618cfa5d5-kube-api-access-m9v95\") pod \"payload-pre-processing-579785bc64-7p7h4\" (UID: \"d4481fc0-c19d-410e-87c5-bd4618cfa5d5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:21.033023 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.032985 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phzgc\" (UniqueName: \"kubernetes.io/projected/5d458b4e-3ba3-4454-9cd0-c53c6d09534c-kube-api-access-phzgc\") pod \"payload-processing-699b6cd6c-hrcmd\" (UID: \"5d458b4e-3ba3-4454-9cd0-c53c6d09534c\") " pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:21.033179 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.033059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9v95\" (UniqueName: \"kubernetes.io/projected/d4481fc0-c19d-410e-87c5-bd4618cfa5d5-kube-api-access-m9v95\") pod \"payload-pre-processing-579785bc64-7p7h4\" (UID: \"d4481fc0-c19d-410e-87c5-bd4618cfa5d5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:21.045373 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.045346 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phzgc\" (UniqueName: \"kubernetes.io/projected/5d458b4e-3ba3-4454-9cd0-c53c6d09534c-kube-api-access-phzgc\") pod \"payload-processing-699b6cd6c-hrcmd\" (UID: \"5d458b4e-3ba3-4454-9cd0-c53c6d09534c\") " pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:21.045595 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.045576 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9v95\" (UniqueName: \"kubernetes.io/projected/d4481fc0-c19d-410e-87c5-bd4618cfa5d5-kube-api-access-m9v95\") pod \"payload-pre-processing-579785bc64-7p7h4\" (UID: \"d4481fc0-c19d-410e-87c5-bd4618cfa5d5\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:21.126903 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.126870 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:21.150089 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.150034 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:21.276159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.276130 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7p7h4"] Jun 10 12:19:21.278161 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:19:21.278129 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4481fc0_c19d_410e_87c5_bd4618cfa5d5.slice/crio-48275f597a5cff36b610cfd9794f99214587c7ea8d42d5ae82525b7eb27e6820 WatchSource:0}: Error finding container 48275f597a5cff36b610cfd9794f99214587c7ea8d42d5ae82525b7eb27e6820: Status 404 returned error can't find the container with id 48275f597a5cff36b610cfd9794f99214587c7ea8d42d5ae82525b7eb27e6820 Jun 10 12:19:21.302171 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.302149 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-hrcmd"] Jun 10 12:19:21.303914 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:19:21.303891 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d458b4e_3ba3_4454_9cd0_c53c6d09534c.slice/crio-15bea203456969c5d75335d0be3802ee066d0e5ae765bee36a19d4b2a71e3872 WatchSource:0}: Error finding container 15bea203456969c5d75335d0be3802ee066d0e5ae765bee36a19d4b2a71e3872: Status 404 returned error can't find the container with id 15bea203456969c5d75335d0be3802ee066d0e5ae765bee36a19d4b2a71e3872 Jun 10 12:19:21.364312 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.364280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" event={"ID":"d4481fc0-c19d-410e-87c5-bd4618cfa5d5","Type":"ContainerStarted","Data":"48275f597a5cff36b610cfd9794f99214587c7ea8d42d5ae82525b7eb27e6820"} Jun 10 12:19:21.365481 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.365460 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-596bd99fdd-9bf9l" event={"ID":"083853e9-9503-44aa-9efa-dc1741eb1c1b","Type":"ContainerStarted","Data":"a799881aaed581f5d5b2942ebc85f56ced9a41bc7fb0fce21a6c31cfc019a822"} Jun 10 12:19:21.366503 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:21.366485 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" event={"ID":"5d458b4e-3ba3-4454-9cd0-c53c6d09534c","Type":"ContainerStarted","Data":"15bea203456969c5d75335d0be3802ee066d0e5ae765bee36a19d4b2a71e3872"} Jun 10 12:19:25.404645 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.404607 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" event={"ID":"d4481fc0-c19d-410e-87c5-bd4618cfa5d5","Type":"ContainerStarted","Data":"f180beb54f8c14305120001d009fa79eaa06f466a6870d12d2e7ab4a91cb3712"} Jun 10 12:19:25.405150 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.404690 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:25.406240 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.406214 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-596bd99fdd-9bf9l" event={"ID":"083853e9-9503-44aa-9efa-dc1741eb1c1b","Type":"ContainerStarted","Data":"af786c80dbd71d4111bec7b99f80ef22e732c1a86a2cc6d4b44319cf324a36fb"} Jun 10 12:19:25.406376 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.406260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:25.407626 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.407609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" event={"ID":"5d458b4e-3ba3-4454-9cd0-c53c6d09534c","Type":"ContainerStarted","Data":"650865d7f8a5b7002f25fcb142eb599ec17ead56e926c2ea3344273125c85b6c"} Jun 10 12:19:25.407908 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.407724 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:25.424162 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.424121 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" podStartSLOduration=2.070756106 podStartE2EDuration="5.424110508s" totalImagesPullingTime="3.353354402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:19:25.42275827 +0000 UTC m=+960.011105131" watchObservedRunningTime="2026-06-10 12:19:25.424110508 +0000 UTC m=+960.012457405" Jun 10 12:19:25.441281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:25.441234 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" podStartSLOduration=2.118801061 podStartE2EDuration="5.441222761s" totalImagesPullingTime="3.3224217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:19:25.43887129 +0000 UTC m=+960.027218149" watchObservedRunningTime="2026-06-10 12:19:25.441222761 +0000 UTC m=+960.029569619" Jun 10 12:19:28.428002 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.427872 2576 generic.go:356] "Generic (PLEG): container finished" podID="b7764dbd-f036-4341-9c8b-b94425856155" containerID="81a7c2ff033299fdec9481513357836565e532601eeeb26bcef0080ad59f735c" exitCode=0 Jun 10 12:19:28.428002 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.427971 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" event={"ID":"b7764dbd-f036-4341-9c8b-b94425856155","Type":"ContainerDied","Data":"81a7c2ff033299fdec9481513357836565e532601eeeb26bcef0080ad59f735c"} Jun 10 12:19:28.428497 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.428363 2576 scope.go:117] "RemoveContainer" containerID="81a7c2ff033299fdec9481513357836565e532601eeeb26bcef0080ad59f735c" Jun 10 12:19:28.429338 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.429313 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:19:28.429398 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.429377 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:19:28.429433 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.429406 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 10 12:19:28.476755 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:28.476705 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-596bd99fdd-9bf9l" podStartSLOduration=4.705630927 podStartE2EDuration="8.476689685s" totalImagesPullingTime="3.771058758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:19:25.462924444 +0000 UTC m=+960.051271305" watchObservedRunningTime="2026-06-10 12:19:28.476689685 +0000 UTC m=+963.065036543" Jun 10 12:19:29.436081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:29.436045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" event={"ID":"b7764dbd-f036-4341-9c8b-b94425856155","Type":"ContainerStarted","Data":"910675de3889c595b7a805632067029ce3e5849e85c89a7ffcf2d5eed572744b"} Jun 10 12:19:30.233685 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:30.233652 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:19:30.234899 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:30.234871 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7hl2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 10 12:19:30.235029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:30.234955 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" podUID="b7764dbd-f036-4341-9c8b-b94425856155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 10 12:19:31.234141 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:31.234106 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7hl2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 10 12:19:31.234520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:31.234186 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" podUID="b7764dbd-f036-4341-9c8b-b94425856155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 10 12:19:31.420050 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:31.420021 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-596bd99fdd-9bf9l" Jun 10 12:19:32.233646 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:32.233607 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7hl2n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jun 10 12:19:32.233818 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:32.233670 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" podUID="b7764dbd-f036-4341-9c8b-b94425856155" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jun 10 12:19:33.237869 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:33.237835 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:19:33.238287 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:33.238143 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:19:33.238833 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:33.238819 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7hl2n" Jun 10 12:19:33.315164 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:33.315129 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:33.315404 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:33.315373 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" containerID="cri-o://3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958" gracePeriod=30 Jun 10 12:19:35.376147 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.376122 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:35.476989 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.476926 2576 generic.go:356] "Generic (PLEG): container finished" podID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerID="3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958" exitCode=143 Jun 10 12:19:35.477159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.476992 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:35.477159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.477031 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6ba2ed26-a158-45cc-8550-19e4af91417d","Type":"ContainerDied","Data":"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958"} Jun 10 12:19:35.477159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.477079 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"6ba2ed26-a158-45cc-8550-19e4af91417d","Type":"ContainerDied","Data":"e1fec9c8543a786e76988366bdca2d33a5e7bcb82c0541cc40bbbce2ddc748fa"} Jun 10 12:19:35.477159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.477103 2576 scope.go:117] "RemoveContainer" containerID="3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958" Jun 10 12:19:35.486669 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.486656 2576 scope.go:117] "RemoveContainer" containerID="3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958" Jun 10 12:19:35.486922 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:19:35.486906 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958\": container with ID starting with 3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958 not found: ID does not exist" containerID="3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958" Jun 10 12:19:35.487006 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.486944 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958"} err="failed to get container status \"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958\": rpc error: code = NotFound desc = could not find container \"3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958\": container with ID starting with 3b32e85cba197d88cce6bb18bdac2df7749bb2539c57bb4a841475fc78ea8958 not found: ID does not exist" Jun 10 12:19:35.514321 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.514297 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftfq8\" (UniqueName: \"kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8\") pod \"6ba2ed26-a158-45cc-8550-19e4af91417d\" (UID: \"6ba2ed26-a158-45cc-8550-19e4af91417d\") " Jun 10 12:19:35.516378 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.516349 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8" (OuterVolumeSpecName: "kube-api-access-ftfq8") pod "6ba2ed26-a158-45cc-8550-19e4af91417d" (UID: "6ba2ed26-a158-45cc-8550-19e4af91417d"). InnerVolumeSpecName "kube-api-access-ftfq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:19:35.615196 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.615160 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftfq8\" (UniqueName: \"kubernetes.io/projected/6ba2ed26-a158-45cc-8550-19e4af91417d-kube-api-access-ftfq8\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:19:35.800698 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.800666 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:35.804081 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.804057 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:35.827970 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.827784 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:35.829979 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.828681 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" Jun 10 12:19:35.829979 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.828707 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" Jun 10 12:19:35.829979 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.828894 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" containerName="keycloak" Jun 10 12:19:35.832974 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.832954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:35.837132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.836674 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 10 12:19:35.837132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.836747 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 10 12:19:35.837132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.836904 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-jnpjt\"" Jun 10 12:19:35.837132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.836995 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 10 12:19:35.837132 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.837058 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 10 12:19:35.838397 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.838376 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:35.900458 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:35.900423 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba2ed26-a158-45cc-8550-19e4af91417d" path="/var/lib/kubelet/pods/6ba2ed26-a158-45cc-8550-19e4af91417d/volumes" Jun 10 12:19:36.019330 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.019300 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bb065d36-5883-401e-bddf-ef3d17a1520e-test-realms\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.019489 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.019371 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6zk\" (UniqueName: \"kubernetes.io/projected/bb065d36-5883-401e-bddf-ef3d17a1520e-kube-api-access-bn6zk\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.120629 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.120543 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bb065d36-5883-401e-bddf-ef3d17a1520e-test-realms\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.120775 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.120626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6zk\" (UniqueName: \"kubernetes.io/projected/bb065d36-5883-401e-bddf-ef3d17a1520e-kube-api-access-bn6zk\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.121363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.121340 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/bb065d36-5883-401e-bddf-ef3d17a1520e-test-realms\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.129790 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.129767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6zk\" (UniqueName: \"kubernetes.io/projected/bb065d36-5883-401e-bddf-ef3d17a1520e-kube-api-access-bn6zk\") pod \"maas-keycloak-0\" (UID: \"bb065d36-5883-401e-bddf-ef3d17a1520e\") " pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.144126 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.144099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:36.280812 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.280783 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 10 12:19:36.281451 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:19:36.281417 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb065d36_5883_401e_bddf_ef3d17a1520e.slice/crio-03b593654b2d2d68c97ac33d8c139aa2c114c267195f08b829e9892a9018f4e2 WatchSource:0}: Error finding container 03b593654b2d2d68c97ac33d8c139aa2c114c267195f08b829e9892a9018f4e2: Status 404 returned error can't find the container with id 03b593654b2d2d68c97ac33d8c139aa2c114c267195f08b829e9892a9018f4e2 Jun 10 12:19:36.417432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.417343 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-hrcmd" Jun 10 12:19:36.417432 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.417411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7p7h4" Jun 10 12:19:36.485801 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:36.485771 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bb065d36-5883-401e-bddf-ef3d17a1520e","Type":"ContainerStarted","Data":"03b593654b2d2d68c97ac33d8c139aa2c114c267195f08b829e9892a9018f4e2"} Jun 10 12:19:37.493745 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:37.493710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bb065d36-5883-401e-bddf-ef3d17a1520e","Type":"ContainerStarted","Data":"a87ac32f066c96d4234c65a67fd8f06eae2fe4e76a6d17c54505808a0565c513"} Jun 10 12:19:37.514385 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:37.514334 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.167293148 podStartE2EDuration="2.514318629s" totalImagesPullingTime="347.025481ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:19:37.510903705 +0000 UTC m=+972.099250576" watchObservedRunningTime="2026-06-10 12:19:37.514318629 +0000 UTC m=+972.102665487" Jun 10 12:19:38.145360 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:38.145257 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:38.147377 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:38.147339 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:39.145290 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:39.145248 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:40.145224 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:40.145174 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:41.144954 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:41.144870 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:42.145119 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:42.145061 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:43.145324 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:43.145269 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:44.144969 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:44.144901 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:45.145098 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:45.145051 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:46.144183 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:46.144152 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:46.144524 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:46.144489 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:47.145356 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:47.145301 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:48.144674 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:48.144634 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:49.145154 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:49.145104 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.60:9000/health/started\": dial tcp 10.134.0.60:9000: connect: connection refused" Jun 10 12:19:50.250779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:50.250729 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 10 12:19:50.268383 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:19:50.268315 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bb065d36-5883-401e-bddf-ef3d17a1520e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 10 12:20:00.257883 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:00.257851 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 10 12:20:23.152604 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.152568 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j"] Jun 10 12:20:23.156349 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.156333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.160463 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.160439 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qflwf\"" Jun 10 12:20:23.160463 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.160459 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 10 12:20:23.160641 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.160490 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 10 12:20:23.160641 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.160463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 10 12:20:23.164788 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.164770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j"] Jun 10 12:20:23.196381 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.196529 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196457 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.196529 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948cdf3-fd2d-45ca-b14b-08a1588caea8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.196643 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196582 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.196643 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8ff6\" (UniqueName: \"kubernetes.io/projected/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kube-api-access-h8ff6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.196643 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.196630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297250 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948cdf3-fd2d-45ca-b14b-08a1588caea8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297390 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297379 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8ff6\" (UniqueName: \"kubernetes.io/projected/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kube-api-access-h8ff6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297705 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297760 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.297809 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.297752 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.299601 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.299583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948cdf3-fd2d-45ca-b14b-08a1588caea8-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.299853 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.299836 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948cdf3-fd2d-45ca-b14b-08a1588caea8-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.305426 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.305404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8ff6\" (UniqueName: \"kubernetes.io/projected/5948cdf3-fd2d-45ca-b14b-08a1588caea8-kube-api-access-h8ff6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j\" (UID: \"5948cdf3-fd2d-45ca-b14b-08a1588caea8\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.468339 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.468310 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:23.606024 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.605994 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j"] Jun 10 12:20:23.606595 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:20:23.606574 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5948cdf3_fd2d_45ca_b14b_08a1588caea8.slice/crio-0c0cc0148f94580e135871f9e33d119b5abf39701b5eadc995d7520b64d2d61a WatchSource:0}: Error finding container 0c0cc0148f94580e135871f9e33d119b5abf39701b5eadc995d7520b64d2d61a: Status 404 returned error can't find the container with id 0c0cc0148f94580e135871f9e33d119b5abf39701b5eadc995d7520b64d2d61a Jun 10 12:20:23.828030 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:23.827950 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" event={"ID":"5948cdf3-fd2d-45ca-b14b-08a1588caea8","Type":"ContainerStarted","Data":"0c0cc0148f94580e135871f9e33d119b5abf39701b5eadc995d7520b64d2d61a"} Jun 10 12:20:27.858906 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:27.858871 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" event={"ID":"5948cdf3-fd2d-45ca-b14b-08a1588caea8","Type":"ContainerStarted","Data":"40dcfeab9c89df6bd74836575b2b9cfec1f6ce8adad94d964cef98b876b90aa7"} Jun 10 12:20:28.866640 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:28.866603 2576 generic.go:356] "Generic (PLEG): container finished" podID="5948cdf3-fd2d-45ca-b14b-08a1588caea8" containerID="40dcfeab9c89df6bd74836575b2b9cfec1f6ce8adad94d964cef98b876b90aa7" exitCode=0 Jun 10 12:20:28.867079 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:28.866686 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" event={"ID":"5948cdf3-fd2d-45ca-b14b-08a1588caea8","Type":"ContainerDied","Data":"40dcfeab9c89df6bd74836575b2b9cfec1f6ce8adad94d964cef98b876b90aa7"} Jun 10 12:20:30.881817 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:30.881779 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" event={"ID":"5948cdf3-fd2d-45ca-b14b-08a1588caea8","Type":"ContainerStarted","Data":"3e251e5e732a331e76e6fbef7063b27ee1beffcc0314162e6febcbb4f8756661"} Jun 10 12:20:30.903072 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:30.903017 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" podStartSLOduration=1.717616595 podStartE2EDuration="7.903001142s" totalImagesPullingTime="4.889159456s" totalInitContainerRuntime="1.296225091s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:20:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:20:30.900914438 +0000 UTC m=+1025.489261310" watchObservedRunningTime="2026-06-10 12:20:30.903001142 +0000 UTC m=+1025.491348000" Jun 10 12:20:33.468737 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:33.468696 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:33.469363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:33.468773 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:33.481026 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:33.481002 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:33.910374 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:33.910284 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j" Jun 10 12:20:45.335672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.335636 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz"] Jun 10 12:20:45.339672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.339652 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.342377 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.342350 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 10 12:20:45.349167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.349147 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz"] Jun 10 12:20:45.423868 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.423840 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqg27\" (UniqueName: \"kubernetes.io/projected/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kube-api-access-wqg27\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.424031 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.423875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.424031 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.423910 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.424031 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.424010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.424140 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.424038 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.424140 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.424070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed966e1b-bf17-4187-8bd9-16894e85b9b8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525164 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525136 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqg27\" (UniqueName: \"kubernetes.io/projected/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kube-api-access-wqg27\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525224 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525278 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed966e1b-bf17-4187-8bd9-16894e85b9b8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525701 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525678 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525787 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525768 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.525846 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.525817 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.527501 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.527480 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed966e1b-bf17-4187-8bd9-16894e85b9b8-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.527655 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.527639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed966e1b-bf17-4187-8bd9-16894e85b9b8-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.533070 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.533046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqg27\" (UniqueName: \"kubernetes.io/projected/ed966e1b-bf17-4187-8bd9-16894e85b9b8-kube-api-access-wqg27\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz\" (UID: \"ed966e1b-bf17-4187-8bd9-16894e85b9b8\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.652733 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.652653 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:45.785127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.785097 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz"] Jun 10 12:20:45.785899 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:20:45.785870 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded966e1b_bf17_4187_8bd9_16894e85b9b8.slice/crio-8fb4b993dcdfe093a5efc6a04c625e7cc30389eb4a7a149008fc634a4373f342 WatchSource:0}: Error finding container 8fb4b993dcdfe093a5efc6a04c625e7cc30389eb4a7a149008fc634a4373f342: Status 404 returned error can't find the container with id 8fb4b993dcdfe093a5efc6a04c625e7cc30389eb4a7a149008fc634a4373f342 Jun 10 12:20:45.972181 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.972150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" event={"ID":"ed966e1b-bf17-4187-8bd9-16894e85b9b8","Type":"ContainerStarted","Data":"5f6c4e638b6c6022bddc0aa6c89440f095ceb4f28d24291ea711e2d5914a9c31"} Jun 10 12:20:45.972354 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:45.972201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" event={"ID":"ed966e1b-bf17-4187-8bd9-16894e85b9b8","Type":"ContainerStarted","Data":"8fb4b993dcdfe093a5efc6a04c625e7cc30389eb4a7a149008fc634a4373f342"} Jun 10 12:20:48.998188 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:48.998154 2576 generic.go:356] "Generic (PLEG): container finished" podID="ed966e1b-bf17-4187-8bd9-16894e85b9b8" containerID="5f6c4e638b6c6022bddc0aa6c89440f095ceb4f28d24291ea711e2d5914a9c31" exitCode=0 Jun 10 12:20:48.998547 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:48.998230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" event={"ID":"ed966e1b-bf17-4187-8bd9-16894e85b9b8","Type":"ContainerDied","Data":"5f6c4e638b6c6022bddc0aa6c89440f095ceb4f28d24291ea711e2d5914a9c31"} Jun 10 12:20:51.012848 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:51.012810 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" event={"ID":"ed966e1b-bf17-4187-8bd9-16894e85b9b8","Type":"ContainerStarted","Data":"0ef502b17f0a40c16e07eeb7b7ac9d928d995374e79a2b849654ea0795ae03c9"} Jun 10 12:20:51.034096 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:51.034034 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" podStartSLOduration=2.121761196 podStartE2EDuration="6.034015357s" totalImagesPullingTime="1.501787564s" totalInitContainerRuntime="2.410466597s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:20:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:20:51.030738964 +0000 UTC m=+1045.619085862" watchObservedRunningTime="2026-06-10 12:20:51.034015357 +0000 UTC m=+1045.622362215" Jun 10 12:20:55.652904 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:55.652855 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:55.653393 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:55.652957 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:55.665215 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:55.665188 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:20:56.052964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:20:56.052919 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz" Jun 10 12:21:13.040832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.040758 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw"] Jun 10 12:21:13.044554 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.044537 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.047384 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.047366 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 10 12:21:13.053367 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.053347 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw"] Jun 10 12:21:13.199855 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.199822 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.200053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.199880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.200053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.199998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.200053 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.200048 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.200196 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.200104 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.200196 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.200136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbcv5\" (UniqueName: \"kubernetes.io/projected/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kube-api-access-hbcv5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.301721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.301721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301676 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbcv5\" (UniqueName: \"kubernetes.io/projected/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kube-api-access-hbcv5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.301721 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302016 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301749 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302016 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302016 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.301810 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302268 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.302239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302268 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.302256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.302425 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.302325 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.304008 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.303987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.304258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.304241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.310256 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.310233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbcv5\" (UniqueName: \"kubernetes.io/projected/7aaebd84-1254-4cc8-b57c-c354ec0c6fbc-kube-api-access-hbcv5\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-8cddw\" (UID: \"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.356569 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.356536 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:13.491289 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:13.491261 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw"] Jun 10 12:21:13.491448 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:21:13.491424 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aaebd84_1254_4cc8_b57c_c354ec0c6fbc.slice/crio-b6674dedc7a5c167c497c05944346d60245c00d9278c585c33c0e0a45b5ec084 WatchSource:0}: Error finding container b6674dedc7a5c167c497c05944346d60245c00d9278c585c33c0e0a45b5ec084: Status 404 returned error can't find the container with id b6674dedc7a5c167c497c05944346d60245c00d9278c585c33c0e0a45b5ec084 Jun 10 12:21:14.157699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:14.157661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" event={"ID":"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc","Type":"ContainerStarted","Data":"9841d89d763917b99f440325e8d0c57a75838250ef444b922d9760b3ce7801e2"} Jun 10 12:21:14.158129 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:14.157721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" event={"ID":"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc","Type":"ContainerStarted","Data":"b6674dedc7a5c167c497c05944346d60245c00d9278c585c33c0e0a45b5ec084"} Jun 10 12:21:41.322334 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:41.322300 2576 generic.go:356] "Generic (PLEG): container finished" podID="7aaebd84-1254-4cc8-b57c-c354ec0c6fbc" containerID="9841d89d763917b99f440325e8d0c57a75838250ef444b922d9760b3ce7801e2" exitCode=0 Jun 10 12:21:41.322726 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:41.322361 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" event={"ID":"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc","Type":"ContainerDied","Data":"9841d89d763917b99f440325e8d0c57a75838250ef444b922d9760b3ce7801e2"} Jun 10 12:21:42.329832 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:42.329799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" event={"ID":"7aaebd84-1254-4cc8-b57c-c354ec0c6fbc","Type":"ContainerStarted","Data":"cebcb841ac08dee4a5cb69ad96e255751bdad4bbaf2696144bfb8d8e996a29e0"} Jun 10 12:21:42.349711 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:42.349659 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" podStartSLOduration=1.596464369 podStartE2EDuration="29.349645717s" totalImagesPullingTime="209.465817ms" totalInitContainerRuntime="27.543715531s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:21:42.348080755 +0000 UTC m=+1096.936427648" watchObservedRunningTime="2026-06-10 12:21:42.349645717 +0000 UTC m=+1096.937992578" Jun 10 12:21:43.357517 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:43.357466 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:43.357966 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:43.357538 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:43.369572 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:43.369548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:21:44.352947 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:21:44.352907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-8cddw" Jun 10 12:23:25.983644 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:25.983614 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:23:25.987649 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:25.987628 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:23:25.989440 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:25.989421 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:23:25.992827 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:25.992810 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:23:51.146666 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.146634 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:23:51.147225 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.146847 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerName="manager" containerID="cri-o://1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc" gracePeriod=30 Jun 10 12:23:51.183127 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.183091 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerName="manager" probeResult="failure" output="Get \"http://10.134.0.56:8081/readyz\": dial tcp 10.134.0.56:8081: connect: connection refused" Jun 10 12:23:51.401299 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.401245 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:23:51.568699 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.568665 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9t9z\" (UniqueName: \"kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z\") pod \"0fe4410b-e386-47ea-aec0-63c3066ad59a\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " Jun 10 12:23:51.568861 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.568761 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert\") pod \"0fe4410b-e386-47ea-aec0-63c3066ad59a\" (UID: \"0fe4410b-e386-47ea-aec0-63c3066ad59a\") " Jun 10 12:23:51.570892 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.570866 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0fe4410b-e386-47ea-aec0-63c3066ad59a" (UID: "0fe4410b-e386-47ea-aec0-63c3066ad59a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:23:51.570964 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.570892 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z" (OuterVolumeSpecName: "kube-api-access-p9t9z") pod "0fe4410b-e386-47ea-aec0-63c3066ad59a" (UID: "0fe4410b-e386-47ea-aec0-63c3066ad59a"). InnerVolumeSpecName "kube-api-access-p9t9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:23:51.670475 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.670393 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9t9z\" (UniqueName: \"kubernetes.io/projected/0fe4410b-e386-47ea-aec0-63c3066ad59a-kube-api-access-p9t9z\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:23:51.670475 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:51.670423 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0fe4410b-e386-47ea-aec0-63c3066ad59a-webhook-cert\") on node \"ip-10-0-143-32.ec2.internal\" DevicePath \"\"" Jun 10 12:23:52.128336 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.128306 2576 generic.go:356] "Generic (PLEG): container finished" podID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerID="1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc" exitCode=0 Jun 10 12:23:52.128543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.128343 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" Jun 10 12:23:52.128543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.128385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" event={"ID":"0fe4410b-e386-47ea-aec0-63c3066ad59a","Type":"ContainerDied","Data":"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc"} Jun 10 12:23:52.128543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.128441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-b7mdp" event={"ID":"0fe4410b-e386-47ea-aec0-63c3066ad59a","Type":"ContainerDied","Data":"69b640373e3bb7f2bcdb93a258167af7401e652a137fd2eced4f2ede17c34ae4"} Jun 10 12:23:52.128543 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.128472 2576 scope.go:117] "RemoveContainer" containerID="1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc" Jun 10 12:23:52.138394 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.138370 2576 scope.go:117] "RemoveContainer" containerID="1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc" Jun 10 12:23:52.138642 ip-10-0-143-32 kubenswrapper[2576]: E0610 12:23:52.138622 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc\": container with ID starting with 1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc not found: ID does not exist" containerID="1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc" Jun 10 12:23:52.138697 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.138649 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc"} err="failed to get container status \"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc\": rpc error: code = NotFound desc = could not find container \"1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc\": container with ID starting with 1458f72a4e9f20b8f9959ef386a71732647762cf88a5c29dcbef28b89c191ebc not found: ID does not exist" Jun 10 12:23:52.147564 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.147543 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:23:52.151550 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:52.151526 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-b7mdp"] Jun 10 12:23:53.901014 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:23:53.900981 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" path="/var/lib/kubelet/pods/0fe4410b-e386-47ea-aec0-63c3066ad59a/volumes" Jun 10 12:28:26.027521 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:28:26.027491 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:28:26.033191 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:28:26.033160 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:28:26.033363 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:28:26.033312 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:28:26.038459 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:28:26.038437 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:33:26.071729 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:33:26.071705 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:33:26.076845 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:33:26.076819 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:33:26.078174 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:33:26.078145 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:33:26.083608 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:33:26.083592 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:38:26.113484 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:38:26.113453 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:38:26.119201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:38:26.119176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:38:26.122740 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:38:26.122723 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:38:26.128075 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:38:26.128056 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:43:26.157444 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:43:26.157418 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:43:26.166463 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:43:26.166434 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:43:26.172123 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:43:26.172098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:43:26.177535 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:43:26.177512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:44:47.906428 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:47.906397 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f895867d-6lsch_4ccb7d08-9333-4c1e-addd-0a1a5a526c3d/nginx/0.log" Jun 10 12:44:48.377582 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:48.377549 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-596bd99fdd-9bf9l_083853e9-9503-44aa-9efa-dc1741eb1c1b/maas-api/0.log" Jun 10 12:44:48.978993 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:48.978959 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-chgg7_254219ff-afec-4e9c-ac5c-d050460fd456/manager/0.log" Jun 10 12:44:48.990251 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:48.990224 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-chgg7_254219ff-afec-4e9c-ac5c-d050460fd456/copy-manifests/0.log" Jun 10 12:44:49.340988 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:49.340896 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2wfs6_843e57dd-01eb-4acc-8aeb-b76675fb56ac/postgres/0.log" Jun 10 12:44:50.105644 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.105612 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/util/0.log" Jun 10 12:44:50.112167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.112141 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/pull/0.log" Jun 10 12:44:50.118506 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.118486 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/extract/0.log" Jun 10 12:44:50.229322 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.229289 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/pull/0.log" Jun 10 12:44:50.235536 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.235511 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/extract/0.log" Jun 10 12:44:50.242077 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.242054 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/util/0.log" Jun 10 12:44:50.353797 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.353763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/extract/0.log" Jun 10 12:44:50.360047 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.359985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/util/0.log" Jun 10 12:44:50.366527 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.366506 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/pull/0.log" Jun 10 12:44:50.477504 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.477476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/util/0.log" Jun 10 12:44:50.483650 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.483621 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/pull/0.log" Jun 10 12:44:50.490015 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.489985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/extract/0.log" Jun 10 12:44:50.981445 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:50.981410 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9gq72_8148e258-d5ff-4489-97e0-8d9e39daa3e5/kuadrant-console-plugin/0.log" Jun 10 12:44:51.101395 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:51.101361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vhfv_45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc/registry-server/0.log" Jun 10 12:44:51.491591 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:51.491565 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fvvz8_aeac6f17-4c7b-4dbd-8a16-2e31439ce70a/manager/0.log" Jun 10 12:44:51.840281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:51.840195 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hfc6_44cd32f7-dad6-4949-90b1-cd597ad0bfa0/istio-proxy/0.log" Jun 10 12:44:52.294318 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:52.294284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/1.log" Jun 10 12:44:52.407718 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:52.407687 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7p7h4_d4481fc0-c19d-410e-87c5-bd4618cfa5d5/payload-pre-processing/0.log" Jun 10 12:44:52.528277 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:52.528238 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-hrcmd_5d458b4e-3ba3-4454-9cd0-c53c6d09534c/payload-processing/0.log" Jun 10 12:44:52.992457 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:52.992429 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j_5948cdf3-fd2d-45ca-b14b-08a1588caea8/storage-initializer/0.log" Jun 10 12:44:52.999332 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:52.999306 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-w7f2j_5948cdf3-fd2d-45ca-b14b-08a1588caea8/main/0.log" Jun 10 12:44:53.233360 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:53.233324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz_ed966e1b-bf17-4187-8bd9-16894e85b9b8/storage-initializer/0.log" Jun 10 12:44:53.241029 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:53.241003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-lw5lz_ed966e1b-bf17-4187-8bd9-16894e85b9b8/main/0.log" Jun 10 12:44:53.482119 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:53.482091 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8cddw_7aaebd84-1254-4cc8-b57c-c354ec0c6fbc/storage-initializer/0.log" Jun 10 12:44:53.489527 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:44:53.489503 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-8cddw_7aaebd84-1254-4cc8-b57c-c354ec0c6fbc/main/0.log" Jun 10 12:45:00.743822 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:00.743784 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qsd5d_e2c1011e-ad04-4614-a3d5-08e7ee8170d0/global-pull-secret-syncer/0.log" Jun 10 12:45:00.917501 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:00.917460 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-w4vtv_059ab479-e5ad-48e1-af81-bb11ea2d77cd/konnectivity-agent/0.log" Jun 10 12:45:00.972201 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:00.972170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-32.ec2.internal_1c4192ae489bc32c73b2d3c76f561d8f/haproxy/0.log" Jun 10 12:45:05.160137 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.160112 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/extract/0.log" Jun 10 12:45:05.179443 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.179412 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/util/0.log" Jun 10 12:45:05.197048 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.197023 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mcnqs_594b7f06-57bc-4289-b5ad-02a725d5fcdd/pull/0.log" Jun 10 12:45:05.232914 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.232889 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/extract/0.log" Jun 10 12:45:05.261556 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.261523 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/util/0.log" Jun 10 12:45:05.281733 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.281709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04c6h9_5243aacb-d852-4676-abbc-993e41f981d0/pull/0.log" Jun 10 12:45:05.315535 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.315512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/extract/0.log" Jun 10 12:45:05.335498 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.335477 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/util/0.log" Jun 10 12:45:05.357385 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.357361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed735p544_8b8c69b9-8d29-43eb-9697-6af1e36b6059/pull/0.log" Jun 10 12:45:05.382423 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.382399 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/extract/0.log" Jun 10 12:45:05.405540 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.405518 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/util/0.log" Jun 10 12:45:05.427736 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.427672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef18g78q_46296c29-1471-4f78-8b07-dbaffd9e1d6e/pull/0.log" Jun 10 12:45:05.807041 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.807016 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-9gq72_8148e258-d5ff-4489-97e0-8d9e39daa3e5/kuadrant-console-plugin/0.log" Jun 10 12:45:05.847561 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.847530 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-5vhfv_45aba94e-dd9f-4b9a-82cb-c9e4cd732ccc/registry-server/0.log" Jun 10 12:45:05.985790 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:05.985757 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-fvvz8_aeac6f17-4c7b-4dbd-8a16-2e31439ce70a/manager/0.log" Jun 10 12:45:07.722034 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.722006 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/alertmanager/0.log" Jun 10 12:45:07.743796 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.743770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/config-reloader/0.log" Jun 10 12:45:07.761482 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.761456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/kube-rbac-proxy-web/0.log" Jun 10 12:45:07.778667 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.778644 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/kube-rbac-proxy/0.log" Jun 10 12:45:07.797896 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.797874 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/kube-rbac-proxy-metric/0.log" Jun 10 12:45:07.815274 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.815245 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/prom-label-proxy/0.log" Jun 10 12:45:07.836833 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.836788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_80d1f15d-231f-4bd0-b241-a8730e5e6496/init-config-reloader/0.log" Jun 10 12:45:07.867033 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.867002 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-2dlgm_76ff5d25-7211-448b-81d5-b9d082c6d06d/cluster-monitoring-operator/0.log" Jun 10 12:45:07.893001 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.892971 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-state-metrics/0.log" Jun 10 12:45:07.907353 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.907328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-rbac-proxy-main/0.log" Jun 10 12:45:07.923494 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:07.923466 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-9scqs_d2e8539b-e0d8-46e7-a604-cc325f65fad7/kube-rbac-proxy-self/0.log" Jun 10 12:45:08.147138 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.147033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/node-exporter/0.log" Jun 10 12:45:08.164672 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.164642 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/kube-rbac-proxy/0.log" Jun 10 12:45:08.182349 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.182328 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-j7fk9_fda64f5e-b014-49a7-a1d8-c78aef725fd4/init-textfile/0.log" Jun 10 12:45:08.450028 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.449956 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-c8jsq_5f9e07b6-802b-430d-bd18-a678c559eba8/prometheus-operator/0.log" Jun 10 12:45:08.465760 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.465736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-c8jsq_5f9e07b6-802b-430d-bd18-a678c559eba8/kube-rbac-proxy/0.log" Jun 10 12:45:08.514115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.514087 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/telemeter-client/0.log" Jun 10 12:45:08.531910 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.531881 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/reload/0.log" Jun 10 12:45:08.553387 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:08.553364 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7f67b65b6f-hpbp8_69c45575-2f72-497f-9d30-7c1efb744022/kube-rbac-proxy/0.log" Jun 10 12:45:11.170461 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:11.170430 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/2.log" Jun 10 12:45:11.174399 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:11.174371 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-jprdj_4ac11464-3642-44c1-a3b3-f5313da89b24/console-operator/3.log" Jun 10 12:45:11.750766 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:11.750738 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8649b67b56-dwc4d_cc0ecb44-5ed1-4bd4-bda0-b0adae376974/console/0.log" Jun 10 12:45:11.786036 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:11.786007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-mtlhg_397c0aa2-2edc-47aa-8611-ea6080ff68dd/download-server/0.log" Jun 10 12:45:12.502871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:12.502837 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-8rn46_fbc763c8-9240-4853-92a4-680992054486/volume-data-source-validator/0.log" Jun 10 12:45:13.626901 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.626864 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7"] Jun 10 12:45:13.627343 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.627329 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerName="manager" Jun 10 12:45:13.627388 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.627345 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerName="manager" Jun 10 12:45:13.627445 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.627436 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fe4410b-e386-47ea-aec0-63c3066ad59a" containerName="manager" Jun 10 12:45:13.630682 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.630666 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.633514 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.633492 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4t8h\"/\"openshift-service-ca.crt\"" Jun 10 12:45:13.635095 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.635075 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4t8h\"/\"kube-root-ca.crt\"" Jun 10 12:45:13.635216 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.635075 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4t8h\"/\"default-dockercfg-zmzdp\"" Jun 10 12:45:13.640196 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.640172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7"] Jun 10 12:45:13.746966 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.746925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wn6xg_ef18a3cb-ef28-4e84-83f3-77ca605680c1/dns/0.log" Jun 10 12:45:13.763012 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.762989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wn6xg_ef18a3cb-ef28-4e84-83f3-77ca605680c1/kube-rbac-proxy/0.log" Jun 10 12:45:13.764177 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.764157 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-proc\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.764247 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.764185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-lib-modules\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.764247 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.764208 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w4f7\" (UniqueName: \"kubernetes.io/projected/74ffef63-2a40-4b2f-a1ab-e8eceea95456-kube-api-access-2w4f7\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.764336 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.764246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-podres\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.764403 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.764390 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-sys\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.860115 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.860090 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5p87_8be82b18-301f-4fdc-b41c-49295824e59f/dns-node-resolver/0.log" Jun 10 12:45:13.864891 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.864866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-sys\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865005 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.864906 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-proc\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865005 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.864922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-lib-modules\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865005 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.864997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w4f7\" (UniqueName: \"kubernetes.io/projected/74ffef63-2a40-4b2f-a1ab-e8eceea95456-kube-api-access-2w4f7\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.865026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-podres\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.865026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-proc\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.865034 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-sys\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865167 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.865139 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-lib-modules\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.865358 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.865188 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/74ffef63-2a40-4b2f-a1ab-e8eceea95456-podres\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.874054 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.874028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w4f7\" (UniqueName: \"kubernetes.io/projected/74ffef63-2a40-4b2f-a1ab-e8eceea95456-kube-api-access-2w4f7\") pod \"perf-node-gather-daemonset-6qxg7\" (UID: \"74ffef63-2a40-4b2f-a1ab-e8eceea95456\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:13.942788 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:13.942687 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:14.086373 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.086340 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7"] Jun 10 12:45:14.087805 ip-10-0-143-32 kubenswrapper[2576]: W0610 12:45:14.087783 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod74ffef63_2a40_4b2f_a1ab_e8eceea95456.slice/crio-65fa43c97e97628e15df9adc1079f49aca5b727739dc35d462f2c1513309de0d WatchSource:0}: Error finding container 65fa43c97e97628e15df9adc1079f49aca5b727739dc35d462f2c1513309de0d: Status 404 returned error can't find the container with id 65fa43c97e97628e15df9adc1079f49aca5b727739dc35d462f2c1513309de0d Jun 10 12:45:14.389851 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.389822 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-664c787486-zrh7f_c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8/registry/0.log" Jun 10 12:45:14.398750 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.398722 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-664c787486-zrh7f_c3b5cf50-e8a3-43bb-aea4-bc0f9b9b0ec8/registry/1.log" Jun 10 12:45:14.451370 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.451337 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zjdl4_ae6c156d-7315-4279-9950-ff2e9b42da0b/node-ca/0.log" Jun 10 12:45:14.836704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.836666 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" event={"ID":"74ffef63-2a40-4b2f-a1ab-e8eceea95456","Type":"ContainerStarted","Data":"a7893932d882fa9ccd560e72ca5445baf8c2c56357d1b4fc43543da47ed78eb5"} Jun 10 12:45:14.837222 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.836723 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" event={"ID":"74ffef63-2a40-4b2f-a1ab-e8eceea95456","Type":"ContainerStarted","Data":"65fa43c97e97628e15df9adc1079f49aca5b727739dc35d462f2c1513309de0d"} Jun 10 12:45:14.837222 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.836749 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:14.854304 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:14.854253 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" podStartSLOduration=1.854234927 podStartE2EDuration="1.854234927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:14.852008443 +0000 UTC m=+2509.440355302" watchObservedRunningTime="2026-06-10 12:45:14.854234927 +0000 UTC m=+2509.442581846" Jun 10 12:45:15.337871 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:15.337843 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hfc6_44cd32f7-dad6-4949-90b1-cd597ad0bfa0/istio-proxy/0.log" Jun 10 12:45:15.461366 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:15.461334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/0.log" Jun 10 12:45:15.491885 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:15.491849 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/1.log" Jun 10 12:45:15.516282 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:15.516251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7p7h4_d4481fc0-c19d-410e-87c5-bd4618cfa5d5/payload-pre-processing/0.log" Jun 10 12:45:15.570520 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:15.570484 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-hrcmd_5d458b4e-3ba3-4454-9cd0-c53c6d09534c/payload-processing/0.log" Jun 10 12:45:16.208258 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.208226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-gq6mr_60f1beb1-dc58-45f0-8efb-8d879a73cd8e/serve-healthcheck-canary/0.log" Jun 10 12:45:16.696955 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.696905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-jpgbr_653dc9bb-b8a7-44cc-9b3f-41dc265169d1/insights-operator/0.log" Jun 10 12:45:16.699275 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.699251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-jpgbr_653dc9bb-b8a7-44cc-9b3f-41dc265169d1/insights-operator/1.log" Jun 10 12:45:16.772612 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.772581 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7mvq_6b261105-87a3-4a16-89ce-2a99c2a1fc05/kube-rbac-proxy/0.log" Jun 10 12:45:16.789623 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.789598 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7mvq_6b261105-87a3-4a16-89ce-2a99c2a1fc05/exporter/0.log" Jun 10 12:45:16.808479 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:16.808446 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-h7mvq_6b261105-87a3-4a16-89ce-2a99c2a1fc05/extractor/0.log" Jun 10 12:45:19.041365 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:19.041340 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7f895867d-6lsch_4ccb7d08-9333-4c1e-addd-0a1a5a526c3d/nginx/0.log" Jun 10 12:45:19.189596 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:19.189561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-596bd99fdd-9bf9l_083853e9-9503-44aa-9efa-dc1741eb1c1b/maas-api/0.log" Jun 10 12:45:19.503452 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:19.503414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-chgg7_254219ff-afec-4e9c-ac5c-d050460fd456/manager/0.log" Jun 10 12:45:19.517540 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:19.517512 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-chgg7_254219ff-afec-4e9c-ac5c-d050460fd456/copy-manifests/0.log" Jun 10 12:45:19.617090 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:19.617058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-2wfs6_843e57dd-01eb-4acc-8aeb-b76675fb56ac/postgres/0.log" Jun 10 12:45:20.853880 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:20.853840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-6qxg7" Jun 10 12:45:21.094360 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:21.094334 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dcc5f6999-8wk2p_3410fa14-8c10-43dd-833b-8953df2dd93e/manager/0.log" Jun 10 12:45:21.121609 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:21.121521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-6w7n4_b62e98a2-6f5d-4933-b5a7-a6ec51644c87/openshift-lws-operator/0.log" Jun 10 12:45:26.425947 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:26.425914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hfc6_44cd32f7-dad6-4949-90b1-cd597ad0bfa0/istio-proxy/0.log" Jun 10 12:45:26.529294 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:26.529251 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/0.log" Jun 10 12:45:26.563725 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:26.563695 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/1.log" Jun 10 12:45:26.583780 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:26.583752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7p7h4_d4481fc0-c19d-410e-87c5-bd4618cfa5d5/payload-pre-processing/0.log" Jun 10 12:45:26.632107 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:26.632074 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-hrcmd_5d458b4e-3ba3-4454-9cd0-c53c6d09534c/payload-processing/0.log" Jun 10 12:45:27.769889 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:27.769861 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hfc6_44cd32f7-dad6-4949-90b1-cd597ad0bfa0/istio-proxy/0.log" Jun 10 12:45:27.880423 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:27.880390 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/0.log" Jun 10 12:45:27.913443 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:27.913400 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/1.log" Jun 10 12:45:27.932704 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:27.932670 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7p7h4_d4481fc0-c19d-410e-87c5-bd4618cfa5d5/payload-pre-processing/0.log" Jun 10 12:45:27.985651 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:27.985617 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-hrcmd_5d458b4e-3ba3-4454-9cd0-c53c6d09534c/payload-processing/0.log" Jun 10 12:45:28.155865 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.155783 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/kube-multus-additional-cni-plugins/0.log" Jun 10 12:45:28.180096 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.180069 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/egress-router-binary-copy/0.log" Jun 10 12:45:28.198478 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.198448 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/cni-plugins/0.log" Jun 10 12:45:28.215841 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.215816 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/bond-cni-plugin/0.log" Jun 10 12:45:28.234923 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.234884 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/routeoverride-cni/0.log" Jun 10 12:45:28.253319 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.253293 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/whereabouts-cni-bincopy/0.log" Jun 10 12:45:28.272281 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.272252 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-f9j8k_f7b585af-6f0e-4829-817d-1de83e444980/whereabouts-cni/0.log" Jun 10 12:45:28.579907 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.579864 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ktjnt_850947fe-3e58-4508-b491-405a5225641b/kube-multus/0.log" Jun 10 12:45:28.726534 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.726505 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mgf74_f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10/network-metrics-daemon/0.log" Jun 10 12:45:28.740785 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:28.740759 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mgf74_f8458f85-7d6d-4ecb-ba39-a8e1c1b1ee10/kube-rbac-proxy/0.log" Jun 10 12:45:29.605050 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.605024 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97955hfc6_44cd32f7-dad6-4949-90b1-cd597ad0bfa0/istio-proxy/0.log" Jun 10 12:45:29.637347 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.637319 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-controller/0.log" Jun 10 12:45:29.651083 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.651059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/0.log" Jun 10 12:45:29.651083 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.651059 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovn-acl-logging/1.log" Jun 10 12:45:29.668067 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.668041 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/kube-rbac-proxy-node/0.log" Jun 10 12:45:29.685779 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.685752 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 12:45:29.699131 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.699105 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/0.log" Jun 10 12:45:29.701139 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.701119 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/northd/0.log" Jun 10 12:45:29.719988 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.719960 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/nbdb/0.log" Jun 10 12:45:29.734600 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.734571 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7hl2n_b7764dbd-f036-4341-9c8b-b94425856155/istio-proxy/1.log" Jun 10 12:45:29.738297 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.738275 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/sbdb/0.log" Jun 10 12:45:29.754159 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.754135 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7p7h4_d4481fc0-c19d-410e-87c5-bd4618cfa5d5/payload-pre-processing/0.log" Jun 10 12:45:29.788970 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.788918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fxflh_b3cba19f-bf89-44d0-9369-fcf7e2ae5a45/ovnkube-controller/0.log" Jun 10 12:45:29.812184 ip-10-0-143-32 kubenswrapper[2576]: I0610 12:45:29.812155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-hrcmd_5d458b4e-3ba3-4454-9cd0-c53c6d09534c/payload-processing/0.log"