Jun 11 19:19:49.149320 ip-10-0-140-225 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 19:19:49.149332 ip-10-0-140-225 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 19:19:49.149339 ip-10-0-140-225 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 19:19:49.149656 ip-10-0-140-225 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 19:20:00.466755 ip-10-0-140-225 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 19:20:00.466769 ip-10-0-140-225 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 8a2d55398b9f48c3bffe64ffe20c4f29 -- Jun 11 19:22:49.168787 ip-10-0-140-225 systemd[1]: Starting Kubernetes Kubelet... Jun 11 19:22:49.554184 ip-10-0-140-225 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:49.554184 ip-10-0-140-225 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 19:22:49.554184 ip-10-0-140-225 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:49.554184 ip-10-0-140-225 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 19:22:49.554184 ip-10-0-140-225 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 19:22:49.555045 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.554266 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 19:22:49.558640 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558618 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.558640 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558636 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.558640 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558642 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.558640 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558647 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558651 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558656 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558660 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558664 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558668 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558671 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558674 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558678 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558684 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558690 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558694 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558698 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558702 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558706 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558709 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558714 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558718 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558722 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558725 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.558890 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558729 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558733 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558737 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558741 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558744 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558748 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558752 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558756 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558760 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558764 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558768 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558772 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558777 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558781 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558786 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558792 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558796 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558801 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558805 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558809 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.559751 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558813 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558817 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558822 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558826 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558830 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558834 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558838 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558843 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558849 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558855 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558860 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558865 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558870 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558874 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558879 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558885 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558889 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558893 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558897 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.560619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558902 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558907 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558911 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558916 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558920 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558925 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558930 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558934 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558938 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558945 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558950 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558954 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558958 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558962 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558966 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558971 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558975 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558979 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558983 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558987 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.561545 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558991 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558995 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.558999 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559003 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559008 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559014 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559020 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559024 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559029 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559033 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559038 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559042 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559050 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559054 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559059 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559063 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.559067 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560221 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560231 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.562405 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560236 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560240 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560246 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560251 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560256 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560260 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560264 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560268 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560272 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560277 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560281 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560285 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560289 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560293 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560297 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560301 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560306 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560310 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560314 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560318 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.563235 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560323 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560327 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560331 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560335 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560339 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560347 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560351 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560355 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560359 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560363 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560368 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560372 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560376 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560380 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560384 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560389 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560394 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560399 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560403 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560407 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.563872 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560411 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560415 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560419 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560423 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560427 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560431 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560435 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560439 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560444 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560449 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560453 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560477 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560485 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560491 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560496 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560501 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560506 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560513 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560518 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560522 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.564493 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560526 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560530 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560535 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560539 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560543 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560548 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560552 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560556 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560560 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560568 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560573 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560577 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560581 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560585 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560589 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560593 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560597 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560601 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560607 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.565194 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560611 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560614 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560618 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560622 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560626 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560630 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560634 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560638 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560643 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560648 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560652 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560659 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560665 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560669 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560674 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560679 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560683 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.560687 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.565732 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561318 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561329 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561334 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561338 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561350 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561355 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561359 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561363 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561368 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561372 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561377 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561380 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561384 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561391 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561397 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561401 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561406 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561410 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561414 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561418 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.566209 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561422 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561426 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561430 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561435 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561438 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561442 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561447 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561452 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561477 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561483 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561487 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561491 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561496 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561500 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561504 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561508 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561513 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561528 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561533 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.566826 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561537 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561541 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561545 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561549 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561553 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561557 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561561 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561565 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561569 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561573 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561576 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561580 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561584 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561588 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561592 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561596 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561599 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561603 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561607 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561613 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.567330 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561617 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561622 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561626 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561630 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561634 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561638 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561642 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561647 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561651 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561655 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561659 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561671 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561676 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561680 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561684 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561688 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561692 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561696 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561700 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561704 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.567878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561709 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561713 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561717 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561721 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561725 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561729 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561738 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561742 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561746 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561750 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561754 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561758 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561762 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561767 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561771 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561775 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561779 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561783 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561787 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.561791 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.568358 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561895 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561905 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561918 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561925 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561939 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561944 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561950 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561957 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561962 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561967 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561972 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561977 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561982 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561986 2562 flags.go:64] FLAG: --cgroup-root="" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561994 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.561998 2562 flags.go:64] FLAG: --client-ca-file="" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562003 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562007 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562020 2562 flags.go:64] FLAG: --cluster-domain="" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562025 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562030 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562034 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562039 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562045 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 19:22:49.568875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562049 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562054 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562059 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562064 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562069 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562073 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562078 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562082 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562088 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562093 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562097 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562102 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562106 2562 flags.go:64] FLAG: --enable-server="true" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562121 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562131 2562 flags.go:64] FLAG: --event-burst="100" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562135 2562 flags.go:64] FLAG: --event-qps="50" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562140 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562145 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562150 2562 flags.go:64] FLAG: --eviction-hard="" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562156 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562160 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562164 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562174 2562 flags.go:64] FLAG: --eviction-soft="" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562178 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562183 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 19:22:49.569683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562187 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562193 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562197 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562202 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562206 2562 flags.go:64] FLAG: --feature-gates="" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562212 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562240 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562246 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562252 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562257 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562262 2562 flags.go:64] FLAG: --help="false" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562266 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562271 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562276 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562280 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562285 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562290 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562295 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562299 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562304 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562309 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562322 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562337 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562343 2562 flags.go:64] FLAG: --kube-reserved="" Jun 11 19:22:49.570692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562348 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562353 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562358 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562362 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562366 2562 flags.go:64] FLAG: --lock-file="" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562372 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562377 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562382 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562390 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562396 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562400 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562405 2562 flags.go:64] FLAG: --logging-format="text" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562410 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562415 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562419 2562 flags.go:64] FLAG: --manifest-url="" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562423 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562430 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562434 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562441 2562 flags.go:64] FLAG: --max-pods="110" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562445 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562450 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562455 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562479 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562484 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562488 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 19:22:49.571301 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562493 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562503 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562507 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562512 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562516 2562 flags.go:64] FLAG: --pod-cidr="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562529 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562538 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562542 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562547 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562551 2562 flags.go:64] FLAG: --port="10250" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562556 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562561 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-060efacc10e8f6df1" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562567 2562 flags.go:64] FLAG: --qos-reserved="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562572 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562577 2562 flags.go:64] FLAG: --register-node="true" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562581 2562 flags.go:64] FLAG: --register-with-taints="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562587 2562 flags.go:64] FLAG: --registry-burst="10" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562593 2562 flags.go:64] FLAG: --registry-qps="5" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562597 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562602 2562 flags.go:64] FLAG: --reserved-memory="" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562608 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562612 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562617 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562621 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562625 2562 flags.go:64] FLAG: --runonce="false" Jun 11 19:22:49.571933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562630 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562635 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562640 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562644 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562649 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562654 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562659 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562663 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562667 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562671 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562676 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562680 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562685 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562702 2562 flags.go:64] FLAG: --system-cgroups="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562707 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562715 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562720 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562724 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562735 2562 flags.go:64] FLAG: --tls-min-version="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562741 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562746 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562750 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562755 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562760 2562 flags.go:64] FLAG: --v="2" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562768 2562 flags.go:64] FLAG: --version="false" Jun 11 19:22:49.572565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562774 2562 flags.go:64] FLAG: --vmodule="" Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562780 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.562785 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563005 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563019 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563024 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563028 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563033 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563037 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563042 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563046 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563050 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563054 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563058 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563062 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563066 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563070 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563074 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563078 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563082 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.573192 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563086 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563098 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563102 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563107 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563111 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563115 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563120 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563124 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563128 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563133 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563137 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563143 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563147 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563152 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563156 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563160 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563167 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563173 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563178 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.573744 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563182 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563187 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563190 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563194 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563199 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563202 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563207 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563213 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563218 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563223 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563227 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563231 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563236 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563240 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563243 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563257 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563262 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563266 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563270 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563276 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.574212 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563280 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563284 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563288 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563292 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563299 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563303 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563307 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563312 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563316 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563320 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563324 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563328 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563332 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563337 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563341 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563345 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563349 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563353 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563358 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563362 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.574784 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563365 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563370 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563374 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563380 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563384 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563389 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563393 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563397 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563409 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563413 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563417 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563422 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563426 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563430 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563434 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563439 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563445 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563449 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563454 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.575264 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563476 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563480 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563484 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.563488 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.564076 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.571486 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.571502 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.571522 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.571527 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571593 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571598 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571601 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571604 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571606 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571609 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.575749 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571612 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571614 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571617 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571621 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571623 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571626 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571629 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571631 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571634 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571637 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571639 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571642 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571644 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571646 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571649 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571651 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571653 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571656 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571658 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571660 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.576132 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571663 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571665 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571668 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571672 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571675 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571677 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571680 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571683 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571686 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571688 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571690 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571693 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571695 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571697 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571700 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571702 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571705 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571707 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571709 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571712 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.576643 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571715 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571717 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571719 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571722 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571724 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571727 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571729 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571732 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571734 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571736 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571739 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571741 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571744 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571748 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571752 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571755 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571758 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571762 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571765 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571767 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.577121 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571770 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571772 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571775 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571777 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571780 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571782 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571784 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571787 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571789 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571791 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571794 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571797 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571801 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571803 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571806 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571809 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571811 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571814 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571817 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.577617 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571819 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571822 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571825 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571827 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571831 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571835 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571837 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571840 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571843 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571846 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571849 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571852 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571854 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571857 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.571862 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:49.578069 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571979 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571984 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571987 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571990 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571992 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571995 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.571997 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572000 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572003 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572005 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572008 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572010 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572013 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572015 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572018 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572020 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572022 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572025 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572028 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572030 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 19:22:49.578437 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572033 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572035 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572037 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572040 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572043 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572045 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572047 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572050 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572053 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572055 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572058 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572060 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572062 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572065 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572067 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572070 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572072 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572074 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572076 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572079 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 19:22:49.578959 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572081 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572083 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572086 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572088 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572091 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572093 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572095 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572098 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572100 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572103 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572105 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572107 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572110 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572112 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572114 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572117 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572119 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572122 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572125 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572127 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 19:22:49.579446 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572130 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572132 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572135 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572137 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572140 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572142 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572144 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572147 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572149 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572151 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572154 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572156 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572159 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572161 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572164 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572166 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572169 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572171 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572174 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 19:22:49.579942 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572177 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572179 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572182 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572184 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572187 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572189 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572191 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572193 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572196 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572198 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572201 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572203 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572207 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572210 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572213 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572216 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572219 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572222 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572225 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 19:22:49.580399 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:49.572228 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.572233 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.572330 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.576675 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.577974 2562 server.go:1019] "Starting client certificate rotation" Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.578074 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.578108 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 19:22:49.580906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.580271 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:22:49.585349 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.585329 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 19:22:49.601424 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.601406 2562 log.go:25] "Validated CRI v1 runtime API" Jun 11 19:22:49.604390 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.604373 2562 log.go:25] "Validated CRI v1 image API" Jun 11 19:22:49.605124 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.605102 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 19:22:49.608197 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.608179 2562 fs.go:135] Filesystem UUIDs: map[2310d052-29d5-4b11-942a-275999b5437b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 90201159-38e2-4f79-9fd2-e3aadc3e96dc:/dev/nvme0n1p3] Jun 11 19:22:49.608257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.608197 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 19:22:49.613449 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.613330 2562 manager.go:216] Machine: {Timestamp:2026-06-11 19:22:49.612103545 +0000 UTC m=+0.328211501 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3124802 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2acde96d093291f8e432f96237a050 SystemUUID:ec2acde9-6d09-3291-f8e4-32f96237a050 BootID:8a2d5539-8b9f-48c3-bffe-64ffe20c4f29 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:86:c3:e3:58:cd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:86:c3:e3:58:cd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0e:ce:9c:cb:f6:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 19:22:49.613449 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.613434 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 19:22:49.613638 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.613530 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 19:22:49.616113 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.616098 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:22:49.616695 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.616672 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 19:22:49.616875 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.616704 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-225.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 19:22:49.617424 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.617412 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 19:22:49.617502 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.617430 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 19:22:49.617502 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.617440 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:22:49.618237 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.618224 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 19:22:49.619547 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.619535 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 19:22:49.622502 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622490 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:22:49.622616 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622607 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 19:22:49.622656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622643 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 11 19:22:49.622686 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622661 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 19:22:49.622686 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622672 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 19:22:49.622686 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622681 2562 kubelet.go:398] "Adding apiserver pod source" Jun 11 19:22:49.622811 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.622694 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 19:22:49.623116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.623104 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:22:49.623147 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.623138 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 19:22:49.625227 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.625212 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 19:22:49.626905 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.626893 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 19:22:49.626947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.626923 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 19:22:49.627506 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627494 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 19:22:49.627568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627511 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 19:22:49.627568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627517 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 19:22:49.627568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627522 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 19:22:49.627568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627530 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 19:22:49.627568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627535 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627579 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627584 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627590 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627595 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627610 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 19:22:49.627702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.627618 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 19:22:49.628359 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.628350 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 19:22:49.628413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.628362 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 19:22:49.631689 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.631670 2562 server.go:1268] "Started kubelet" Jun 11 19:22:49.631817 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.631761 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 19:22:49.631817 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.631806 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 19:22:49.631951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.631840 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 19:22:49.636302 ip-10-0-140-225 systemd[1]: Started Kubernetes Kubelet. Jun 11 19:22:49.637023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.636923 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnv7j" Jun 11 19:22:49.637408 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.637320 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 19:22:49.638521 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.638495 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-225.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 19:22:49.638641 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.638617 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-225.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 19:22:49.639665 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.639648 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 11 19:22:49.639941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.639903 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnv7j" Jun 11 19:22:49.642879 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.642866 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 19:22:49.642955 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.642943 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 19:22:49.645024 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.642968 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:49.645564 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.645535 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 19:22:49.645752 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.645581 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 19:22:49.645808 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.645756 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 19:22:49.645931 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.645918 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 11 19:22:49.645975 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.645934 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 11 19:22:49.649072 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649056 2562 factory.go:55] Registering systemd factory Jun 11 19:22:49.649072 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649072 2562 factory.go:223] Registration of the systemd container factory successfully Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.649170 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649251 2562 factory.go:153] Registering CRI-O factory Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649263 2562 factory.go:223] Registration of the crio container factory successfully Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649309 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649332 2562 factory.go:103] Registering Raw factory Jun 11 19:22:49.649523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649352 2562 manager.go:1196] Started watching for new ooms in manager Jun 11 19:22:49.649944 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.649930 2562 manager.go:349] Starting recovery of all containers Jun 11 19:22:49.654422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.654397 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:49.658106 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.657943 2562 manager.go:354] Recovery completed Jun 11 19:22:49.658183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.658112 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:49.658543 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.658525 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-225.ec2.internal\" not found" node="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.663022 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.663008 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.664886 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.664870 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.664951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.664899 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.664951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.664909 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.665403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.665391 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 19:22:49.665403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.665402 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 19:22:49.665505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.665417 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 19:22:49.665505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.665453 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.666085 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666068 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.666153 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666100 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.666153 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666111 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.666726 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666712 2562 policy_none.go:49] "None policy: Start" Jun 11 19:22:49.666786 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666730 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 19:22:49.666786 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.666744 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 19:22:49.667826 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.667813 2562 policy_none.go:47] "Start" Jun 11 19:22:49.702048 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702032 2562 manager.go:337] "Starting Device Plugin manager" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.702075 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702088 2562 server.go:87] "Starting device plugin registration server" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702319 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702329 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702506 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702579 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.702584 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.703117 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.703160 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.714148 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.715447 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.715498 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.715516 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.715546 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 19:22:49.723396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.717910 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:49.803315 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.803295 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.804053 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.804039 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.804111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.804066 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.804111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.804076 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.804111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.804096 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.813304 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.813265 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.813304 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.813283 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-225.ec2.internal\": node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:49.816096 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.816069 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal"] Jun 11 19:22:49.816147 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.816136 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.818289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.818270 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.818289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.818304 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.818497 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.818319 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.819839 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.819824 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.819941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.819926 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.819986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.819954 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.820495 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.820479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.820580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.820505 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.820580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.820517 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.821099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.821084 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.821159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.821115 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.821159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.821128 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.822428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.822413 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.822494 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.822444 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 19:22:49.823082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.823067 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientMemory" Jun 11 19:22:49.823139 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.823099 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 19:22:49.823139 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.823115 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeHasSufficientPID" Jun 11 19:22:49.829449 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.829434 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:49.850068 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.850048 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-225.ec2.internal\" not found" node="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.854471 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.854442 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-225.ec2.internal\" not found" node="ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.930531 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:49.930498 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:49.946781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.946758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/041ab909f1899d0af10f7e972f3a84b2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-225.ec2.internal\" (UID: \"041ab909f1899d0af10f7e972f3a84b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.946863 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.946787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:49.946863 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:49.946814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.031626 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.031581 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.047963 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.047939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.048083 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.047974 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.048083 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.047998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/041ab909f1899d0af10f7e972f3a84b2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-225.ec2.internal\" (UID: \"041ab909f1899d0af10f7e972f3a84b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.048083 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.048047 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.048192 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.048045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6eea7193e37fd72ee4297798599520cf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal\" (UID: \"6eea7193e37fd72ee4297798599520cf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.048192 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.048048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/041ab909f1899d0af10f7e972f3a84b2-config\") pod \"kube-apiserver-proxy-ip-10-0-140-225.ec2.internal\" (UID: \"041ab909f1899d0af10f7e972f3a84b2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.132448 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.132369 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.152839 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.152807 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.157598 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.157579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:50.233162 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.233127 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.333623 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.333599 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.434103 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.434079 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.534806 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.534780 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.578170 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.578131 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 19:22:50.578692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.578337 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:22:50.578692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.578335 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:22:50.578692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.578337 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 19:22:50.635550 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.635507 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.649224 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.649184 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 19:17:49 +0000 UTC" deadline="2028-02-21 08:22:36.412370416 +0000 UTC" Jun 11 19:22:50.649224 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.649210 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14868h59m45.763163148s" Jun 11 19:22:50.663900 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:50.663875 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod041ab909f1899d0af10f7e972f3a84b2.slice/crio-db82a1f2446f34574aae8881c8742b61ff71f8748c7884c3b0c954ce0386905c WatchSource:0}: Error finding container db82a1f2446f34574aae8881c8742b61ff71f8748c7884c3b0c954ce0386905c: Status 404 returned error can't find the container with id db82a1f2446f34574aae8881c8742b61ff71f8748c7884c3b0c954ce0386905c Jun 11 19:22:50.664601 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:50.664582 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eea7193e37fd72ee4297798599520cf.slice/crio-e53623006db2915fbb709df6f7b7170dcd0f4c3e91c8cd572f758b27f2bcec5c WatchSource:0}: Error finding container e53623006db2915fbb709df6f7b7170dcd0f4c3e91c8cd572f758b27f2bcec5c: Status 404 returned error can't find the container with id e53623006db2915fbb709df6f7b7170dcd0f4c3e91c8cd572f758b27f2bcec5c Jun 11 19:22:50.670108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.670088 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:22:50.719093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.719016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" event={"ID":"041ab909f1899d0af10f7e972f3a84b2","Type":"ContainerStarted","Data":"db82a1f2446f34574aae8881c8742b61ff71f8748c7884c3b0c954ce0386905c"} Jun 11 19:22:50.720069 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:50.720051 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" event={"ID":"6eea7193e37fd72ee4297798599520cf","Type":"ContainerStarted","Data":"e53623006db2915fbb709df6f7b7170dcd0f4c3e91c8cd572f758b27f2bcec5c"} Jun 11 19:22:50.736193 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.736174 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.836605 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.836580 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:50.937163 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:50.937134 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:51.037704 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.037640 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:51.138562 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.138524 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-225.ec2.internal\" not found" Jun 11 19:22:51.190099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.190065 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:51.245813 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.245596 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" Jun 11 19:22:51.257540 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.257158 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:22:51.257540 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.257302 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" Jun 11 19:22:51.266021 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.265993 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 19:22:51.479176 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.479145 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:51.601396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.601219 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:51.624267 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.624236 2562 apiserver.go:52] "Watching apiserver" Jun 11 19:22:51.631686 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.630768 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 19:22:51.631686 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.631261 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-6xwzk","openshift-multus/multus-kqspm","openshift-network-operator/iptables-alerter-nhn5w","openshift-ovn-kubernetes/ovnkube-node-q99ll","kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal","openshift-cluster-node-tuning-operator/tuned-9frqc","openshift-dns/node-resolver-bqxnl","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal","openshift-multus/network-metrics-daemon-z2kjx","openshift-network-diagnostics/network-check-target-cpl2n","kube-system/global-pull-secret-syncer-nf6pg","kube-system/konnectivity-agent-2x6j2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc","openshift-image-registry/node-ca-rvbz5"] Jun 11 19:22:51.633632 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.633034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.634419 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.634399 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.636030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.635782 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.636030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.635856 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.636030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.635898 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dhxrp\"" Jun 11 19:22:51.636030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.635964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.636994 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.636683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 19:22:51.636994 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.636818 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kvmvt\"" Jun 11 19:22:51.636994 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.636853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 19:22:51.637223 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.637141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.638096 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.638075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.638195 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.638141 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-kq54f\"" Jun 11 19:22:51.638263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.638248 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 19:22:51.638710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.638399 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.638710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.638451 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.639240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639222 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.639880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639708 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 19:22:51.639880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639756 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 19:22:51.639880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639778 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 19:22:51.639880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639819 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fwsn5\"" Jun 11 19:22:51.639880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 19:22:51.640240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.639979 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.640240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.640012 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.641183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.640715 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.641183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.640776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sbgzx\"" Jun 11 19:22:51.641183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.640718 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.641183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.641054 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 19:22:51.642368 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.642119 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ls6xl\"" Jun 11 19:22:51.642368 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.642247 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.642368 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.642290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.642566 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.642372 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:22:51.642566 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.642456 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.643754 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.643732 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.645719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.645700 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.649544 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.648535 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650300 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650483 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.650552 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650683 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.650731 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.651145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.650913 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.652232 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.651794 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2jhlz\"" Jun 11 19:22:51.653957 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.653923 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 19:22:51.654149 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654132 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 19:22:51.654381 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654363 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 19:22:51.654381 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654374 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-hpvbj\"" Jun 11 19:22:51.654603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654588 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8wwmh\"" Jun 11 19:22:51.654672 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654627 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 19:22:51.654720 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654703 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 19:22:51.654931 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.654909 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.655859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-sys\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.655893 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-lib-modules\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.655918 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-var-lib-kubelet\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.655944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.655971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-device-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656015 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-var-lib-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656062 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysconfig\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656108 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-sys-fs\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2px29\" (UniqueName: \"kubernetes.io/projected/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kube-api-access-2px29\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656173 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317c1c25-d853-424a-834d-b3dd30727248-host\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lc8l8\" (UniqueName: \"kubernetes.io/projected/317c1c25-d853-424a-834d-b3dd30727248-kube-api-access-lc8l8\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656223 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-k8s-cni-cncf-io\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:51.657054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656337 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656367 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-netd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovn-node-metrics-cert\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-cni-binary-copy\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656434 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-hostroot\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-systemd-units\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656523 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-slash\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-config\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656558 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9mdh\" (UniqueName: \"kubernetes.io/projected/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-kube-api-access-s9mdh\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656582 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-systemd\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-socket-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656632 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-bin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656674 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-run\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f679210-6132-47f9-a853-9bf0db227eab-konnectivity-ca\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxsxx\" (UniqueName: \"kubernetes.io/projected/5c04613d-f963-49c3-bcdc-134f64d303fc-kube-api-access-rxsxx\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-etc-kubernetes\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-etc-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.657831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656859 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-env-overrides\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-netns\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-multus\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-os-release\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-cnibin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.656987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd362c8-b36a-406b-8b00-02ea92528c15-hosts-file\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657011 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657054 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-host\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-registration-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657144 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c04613d-f963-49c3-bcdc-134f64d303fc-iptables-alerter-script\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-socket-dir-parent\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5p9\" (UniqueName: \"kubernetes.io/projected/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-kube-api-access-dh5p9\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657227 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-cnibin\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd362c8-b36a-406b-8b00-02ea92528c15-tmp-dir\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.658425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-285vn\" (UniqueName: \"kubernetes.io/projected/1b6c30e3-7f49-4650-b7df-bf619477ddc2-kube-api-access-285vn\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-system-cni-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-conf-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-tuned\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c04613d-f963-49c3-bcdc-134f64d303fc-host-slash\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657419 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dd2zc\" (UniqueName: \"kubernetes.io/projected/95357c9a-ca54-44e6-85f5-049e1d925a1c-kube-api-access-dd2zc\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657445 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-conf\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-bin\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657511 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-modprobe-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-netns\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-systemd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-ovn\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-kubernetes\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.659183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317c1c25-d853-424a-834d-b3dd30727248-serviceca\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657705 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-os-release\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-kubelet\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657776 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-script-lib\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f679210-6132-47f9-a853-9bf0db227eab-agent-certs\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657819 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-system-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-kubelet\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657864 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhmp\" (UniqueName: \"kubernetes.io/projected/0fd362c8-b36a-406b-8b00-02ea92528c15-kube-api-access-9qhmp\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-node-log\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657909 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-tmp\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657954 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-daemon-config\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-multus-certs\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.657998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.658020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdwlv\" (UniqueName: \"kubernetes.io/projected/4298435a-2026-4105-8ece-f13f2c568c64-kube-api-access-xdwlv\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.660016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.658042 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-log-socket\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.662977 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.662956 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 19:22:51.678642 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.678621 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-czhh8" Jun 11 19:22:51.684351 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.684332 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-czhh8" Jun 11 19:22:51.746623 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.746567 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 19:22:51.758328 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758305 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-host\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-registration-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758373 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c04613d-f963-49c3-bcdc-134f64d303fc-iptables-alerter-script\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758406 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-socket-dir-parent\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-host\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758505 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-registration-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758510 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5p9\" (UniqueName: \"kubernetes.io/projected/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-kube-api-access-dh5p9\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758567 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-cnibin\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758589 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd362c8-b36a-406b-8b00-02ea92528c15-tmp-dir\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-285vn\" (UniqueName: \"kubernetes.io/projected/1b6c30e3-7f49-4650-b7df-bf619477ddc2-kube-api-access-285vn\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758622 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-system-cni-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-conf-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758647 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-socket-dir-parent\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-kubelet-config\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-tuned\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c04613d-f963-49c3-bcdc-134f64d303fc-host-slash\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.758757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dd2zc\" (UniqueName: \"kubernetes.io/projected/95357c9a-ca54-44e6-85f5-049e1d925a1c-kube-api-access-dd2zc\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-conf\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-bin\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-modprobe-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-netns\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-systemd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-ovn\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0fd362c8-b36a-406b-8b00-02ea92528c15-tmp-dir\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-kubernetes\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758960 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317c1c25-d853-424a-834d-b3dd30727248-serviceca\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.758989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-os-release\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759007 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5c04613d-f963-49c3-bcdc-134f64d303fc-iptables-alerter-script\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-kubelet\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-etc-selinux\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.759190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-script-lib\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f679210-6132-47f9-a853-9bf0db227eab-agent-certs\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759114 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-system-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-modprobe-d\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759139 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-kubelet\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhmp\" (UniqueName: \"kubernetes.io/projected/0fd362c8-b36a-406b-8b00-02ea92528c15-kube-api-access-9qhmp\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-node-log\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-tmp\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-daemon-config\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-multus-certs\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdwlv\" (UniqueName: \"kubernetes.io/projected/4298435a-2026-4105-8ece-f13f2c568c64-kube-api-access-xdwlv\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-system-cni-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-log-socket\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759442 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-conf-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759455 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-sys\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.759781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759502 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-lib-modules\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759587 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-bin\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759623 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-cnibin\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-sys\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759703 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-script-lib\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759757 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-netns\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-systemd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-ovn\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-kubernetes\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759934 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.759945 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-binary-copy\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760239 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-log-socket\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-var-lib-kubelet\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-device-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-var-lib-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.760422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysconfig\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-sys-fs\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2px29\" (UniqueName: \"kubernetes.io/projected/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kube-api-access-2px29\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317c1c25-d853-424a-834d-b3dd30727248-host\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lc8l8\" (UniqueName: \"kubernetes.io/projected/317c1c25-d853-424a-834d-b3dd30727248-kube-api-access-lc8l8\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-k8s-cni-cncf-io\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-var-lib-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760761 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-system-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-node-log\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760811 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-run-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-kubelet\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-daemon-config\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760892 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-os-release\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760974 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/317c1c25-d853-424a-834d-b3dd30727248-serviceca\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysctl-conf\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761049 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-netd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovn-node-metrics-cert\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.761097 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-cni-binary-copy\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.760762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-lib-modules\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761206 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-var-lib-kubelet\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.761283 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.261261794 +0000 UTC m=+2.977369754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-device-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761315 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-sysconfig\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.761978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.761351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-cni-netd\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.766595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.766540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5c04613d-f963-49c3-bcdc-134f64d303fc-host-slash\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.766984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.766949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-tuned\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-multus-cni-dir\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767148 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-k8s-cni-cncf-io\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/317c1c25-d853-424a-834d-b3dd30727248-host\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-hostroot\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767747 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-systemd-units\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-slash\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-config\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9mdh\" (UniqueName: \"kubernetes.io/projected/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-kube-api-access-s9mdh\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.767904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-systemd\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-socket-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768037 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-bin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768069 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-dbus\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-run\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f679210-6132-47f9-a853-9bf0db227eab-konnectivity-ca\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768193 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxsxx\" (UniqueName: \"kubernetes.io/projected/5c04613d-f963-49c3-bcdc-134f64d303fc-kube-api-access-rxsxx\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.768534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-etc-kubernetes\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.769413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-etc-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.769413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768290 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-env-overrides\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.769413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-netns\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.769413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.768426 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-multus\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769699 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-sys-fs\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769742 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-run\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769788 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b6c30e3-7f49-4650-b7df-bf619477ddc2-etc-systemd\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-hostroot\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-systemd-units\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.769967 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-slash\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-multus\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770341 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/95357c9a-ca54-44e6-85f5-049e1d925a1c-cni-binary-copy\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-socket-dir\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-var-lib-cni-bin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-host-kubelet\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovnkube-config\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770500 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-etc-kubernetes\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-run-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-env-overrides\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-multus-certs\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.771159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-etc-openvswitch\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.770685 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-host-run-netns\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.771151 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5f679210-6132-47f9-a853-9bf0db227eab-konnectivity-ca\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.771238 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-os-release\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.771286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-cnibin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.771324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd362c8-b36a-406b-8b00-02ea92528c15-hosts-file\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.771357 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.772232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4298435a-2026-4105-8ece-f13f2c568c64-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.772342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.772333 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4298435a-2026-4105-8ece-f13f2c568c64-os-release\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.772760 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.772542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/95357c9a-ca54-44e6-85f5-049e1d925a1c-cnibin\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.772760 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.772704 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b6c30e3-7f49-4650-b7df-bf619477ddc2-tmp\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.772870 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.772780 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0fd362c8-b36a-406b-8b00-02ea92528c15-hosts-file\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.773212 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.773195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5f679210-6132-47f9-a853-9bf0db227eab-agent-certs\") pod \"konnectivity-agent-2x6j2\" (UID: \"5f679210-6132-47f9-a853-9bf0db227eab\") " pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.773306 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.773261 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-285vn\" (UniqueName: \"kubernetes.io/projected/1b6c30e3-7f49-4650-b7df-bf619477ddc2-kube-api-access-285vn\") pod \"tuned-9frqc\" (UID: \"1b6c30e3-7f49-4650-b7df-bf619477ddc2\") " pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.774634 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.774617 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:51.774731 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.774639 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:51.774731 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.774659 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:51.774731 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.774725 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.274700447 +0000 UTC m=+2.990808405 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:51.775296 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.775273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5p9\" (UniqueName: \"kubernetes.io/projected/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-kube-api-access-dh5p9\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:51.775414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.775275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-ovn-node-metrics-cert\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.776007 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.775959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdwlv\" (UniqueName: \"kubernetes.io/projected/4298435a-2026-4105-8ece-f13f2c568c64-kube-api-access-xdwlv\") pod \"multus-additional-cni-plugins-6xwzk\" (UID: \"4298435a-2026-4105-8ece-f13f2c568c64\") " pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:51.776817 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.776765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dd2zc\" (UniqueName: \"kubernetes.io/projected/95357c9a-ca54-44e6-85f5-049e1d925a1c-kube-api-access-dd2zc\") pod \"multus-kqspm\" (UID: \"95357c9a-ca54-44e6-85f5-049e1d925a1c\") " pod="openshift-multus/multus-kqspm" Jun 11 19:22:51.778305 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.778070 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lc8l8\" (UniqueName: \"kubernetes.io/projected/317c1c25-d853-424a-834d-b3dd30727248-kube-api-access-lc8l8\") pod \"node-ca-rvbz5\" (UID: \"317c1c25-d853-424a-834d-b3dd30727248\") " pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.778305 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.778053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhmp\" (UniqueName: \"kubernetes.io/projected/0fd362c8-b36a-406b-8b00-02ea92528c15-kube-api-access-9qhmp\") pod \"node-resolver-bqxnl\" (UID: \"0fd362c8-b36a-406b-8b00-02ea92528c15\") " pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.778885 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.778865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxsxx\" (UniqueName: \"kubernetes.io/projected/5c04613d-f963-49c3-bcdc-134f64d303fc-kube-api-access-rxsxx\") pod \"iptables-alerter-nhn5w\" (UID: \"5c04613d-f963-49c3-bcdc-134f64d303fc\") " pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.779310 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.779272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9mdh\" (UniqueName: \"kubernetes.io/projected/45ab4f29-c98f-4841-a3fe-80f84c19ad6b-kube-api-access-s9mdh\") pod \"ovnkube-node-q99ll\" (UID: \"45ab4f29-c98f-4841-a3fe-80f84c19ad6b\") " pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.779442 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.779426 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2px29\" (UniqueName: \"kubernetes.io/projected/a1507e62-c144-4f9f-acf5-9c0a02fbed5e-kube-api-access-2px29\") pod \"aws-ebs-csi-driver-node-chblc\" (UID: \"a1507e62-c144-4f9f-acf5-9c0a02fbed5e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:51.872314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.872286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.872507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.872328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-dbus\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.872507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.872368 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-kubelet-config\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.872507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.872444 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-kubelet-config\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.872507 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.872452 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:51.872705 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:51.872547 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:52.372527549 +0000 UTC m=+3.088635493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:51.872705 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.872585 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5bc9c87-26e2-4b39-becf-3d53b14a4977-dbus\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:51.946028 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.945986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bqxnl" Jun 11 19:22:51.961697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.961672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:22:51.970269 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.970238 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nhn5w" Jun 11 19:22:51.975662 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.975644 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:22:51.981709 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.981688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rvbz5" Jun 11 19:22:51.988561 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.988543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9frqc" Jun 11 19:22:51.995377 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:51.995361 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" Jun 11 19:22:52.003940 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.003925 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kqspm" Jun 11 19:22:52.009549 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.009532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" Jun 11 19:22:52.131125 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.131094 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 19:22:52.274919 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.274834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:52.274919 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.274880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275009 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275022 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275028 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275047 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275097 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:53.275075509 +0000 UTC m=+3.991183466 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:52.275115 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.275117 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:53.275106626 +0000 UTC m=+3.991214574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:52.375390 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.375362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:52.375586 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.375481 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:52.375586 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:52.375539 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:53.375525276 +0000 UTC m=+4.091633218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:52.544010 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.543377 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f679210_6132_47f9_a853_9bf0db227eab.slice/crio-2ce11974efe36bcdfd2cfbfa9212352bf4db12e34317cae12b5e6eb153c5b400 WatchSource:0}: Error finding container 2ce11974efe36bcdfd2cfbfa9212352bf4db12e34317cae12b5e6eb153c5b400: Status 404 returned error can't find the container with id 2ce11974efe36bcdfd2cfbfa9212352bf4db12e34317cae12b5e6eb153c5b400 Jun 11 19:22:52.544495 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.544447 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317c1c25_d853_424a_834d_b3dd30727248.slice/crio-ada3d8447b4ab0b6d8901e1d92b3ce53aaa0b47526d75a31476e487f4b979290 WatchSource:0}: Error finding container ada3d8447b4ab0b6d8901e1d92b3ce53aaa0b47526d75a31476e487f4b979290: Status 404 returned error can't find the container with id ada3d8447b4ab0b6d8901e1d92b3ce53aaa0b47526d75a31476e487f4b979290 Jun 11 19:22:52.545379 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.545351 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b6c30e3_7f49_4650_b7df_bf619477ddc2.slice/crio-f3f0d050a276ae55bf7e7cdf1961318857f9ebfdb0bbdec4f588ecb076440656 WatchSource:0}: Error finding container f3f0d050a276ae55bf7e7cdf1961318857f9ebfdb0bbdec4f588ecb076440656: Status 404 returned error can't find the container with id f3f0d050a276ae55bf7e7cdf1961318857f9ebfdb0bbdec4f588ecb076440656 Jun 11 19:22:52.550855 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.550832 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4298435a_2026_4105_8ece_f13f2c568c64.slice/crio-28f5be9cbeb3469f9146c7fce1eafa5b8e2a70c22d577f29c5670b1151f5224b WatchSource:0}: Error finding container 28f5be9cbeb3469f9146c7fce1eafa5b8e2a70c22d577f29c5670b1151f5224b: Status 404 returned error can't find the container with id 28f5be9cbeb3469f9146c7fce1eafa5b8e2a70c22d577f29c5670b1151f5224b Jun 11 19:22:52.552129 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.552110 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95357c9a_ca54_44e6_85f5_049e1d925a1c.slice/crio-c60636495f93472f091d7cb65e462cebc359a7b0bb5836bfe102957841095d38 WatchSource:0}: Error finding container c60636495f93472f091d7cb65e462cebc359a7b0bb5836bfe102957841095d38: Status 404 returned error can't find the container with id c60636495f93472f091d7cb65e462cebc359a7b0bb5836bfe102957841095d38 Jun 11 19:22:52.553288 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.553267 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c04613d_f963_49c3_bcdc_134f64d303fc.slice/crio-2e7d020f4219ab223861cb0f7ba7fa8854b55ffb59726f1101c6a83baa989e44 WatchSource:0}: Error finding container 2e7d020f4219ab223861cb0f7ba7fa8854b55ffb59726f1101c6a83baa989e44: Status 404 returned error can't find the container with id 2e7d020f4219ab223861cb0f7ba7fa8854b55ffb59726f1101c6a83baa989e44 Jun 11 19:22:52.554967 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.554930 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fd362c8_b36a_406b_8b00_02ea92528c15.slice/crio-d36e3ea5ddd56da45567fcc390d092c2025c886066459a41e1ec72b7358763e0 WatchSource:0}: Error finding container d36e3ea5ddd56da45567fcc390d092c2025c886066459a41e1ec72b7358763e0: Status 404 returned error can't find the container with id d36e3ea5ddd56da45567fcc390d092c2025c886066459a41e1ec72b7358763e0 Jun 11 19:22:52.555788 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.555448 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1507e62_c144_4f9f_acf5_9c0a02fbed5e.slice/crio-9ad8a1ae30b43a3d44f8bac883cfbdd3efcf4cd919703214f50242e197172ac1 WatchSource:0}: Error finding container 9ad8a1ae30b43a3d44f8bac883cfbdd3efcf4cd919703214f50242e197172ac1: Status 404 returned error can't find the container with id 9ad8a1ae30b43a3d44f8bac883cfbdd3efcf4cd919703214f50242e197172ac1 Jun 11 19:22:52.557880 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:22:52.557837 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45ab4f29_c98f_4841_a3fe_80f84c19ad6b.slice/crio-6dde7a987fab8ae5f90997a6a40c4792887a9f2d7c697c4f9d1c679eb0cc9d76 WatchSource:0}: Error finding container 6dde7a987fab8ae5f90997a6a40c4792887a9f2d7c697c4f9d1c679eb0cc9d76: Status 404 returned error can't find the container with id 6dde7a987fab8ae5f90997a6a40c4792887a9f2d7c697c4f9d1c679eb0cc9d76 Jun 11 19:22:52.686787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.686620 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:17:51 +0000 UTC" deadline="2028-02-28 12:44:24.611244384 +0000 UTC" Jun 11 19:22:52.686787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.686786 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15041h21m31.924462845s" Jun 11 19:22:52.727023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.725094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rvbz5" event={"ID":"317c1c25-d853-424a-834d-b3dd30727248","Type":"ContainerStarted","Data":"ada3d8447b4ab0b6d8901e1d92b3ce53aaa0b47526d75a31476e487f4b979290"} Jun 11 19:22:52.728250 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.728222 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x6j2" event={"ID":"5f679210-6132-47f9-a853-9bf0db227eab","Type":"ContainerStarted","Data":"2ce11974efe36bcdfd2cfbfa9212352bf4db12e34317cae12b5e6eb153c5b400"} Jun 11 19:22:52.729429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.729408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"6dde7a987fab8ae5f90997a6a40c4792887a9f2d7c697c4f9d1c679eb0cc9d76"} Jun 11 19:22:52.730507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.730487 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhn5w" event={"ID":"5c04613d-f963-49c3-bcdc-134f64d303fc","Type":"ContainerStarted","Data":"2e7d020f4219ab223861cb0f7ba7fa8854b55ffb59726f1101c6a83baa989e44"} Jun 11 19:22:52.731604 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.731584 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerStarted","Data":"28f5be9cbeb3469f9146c7fce1eafa5b8e2a70c22d577f29c5670b1151f5224b"} Jun 11 19:22:52.732732 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.732701 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9frqc" event={"ID":"1b6c30e3-7f49-4650-b7df-bf619477ddc2","Type":"ContainerStarted","Data":"f3f0d050a276ae55bf7e7cdf1961318857f9ebfdb0bbdec4f588ecb076440656"} Jun 11 19:22:52.735284 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.735262 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" event={"ID":"041ab909f1899d0af10f7e972f3a84b2","Type":"ContainerStarted","Data":"fa5b14bb871111e5ad1064c33746bcf8d703a12a8b3c21285cd591034bc438a6"} Jun 11 19:22:52.736509 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.736484 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" event={"ID":"a1507e62-c144-4f9f-acf5-9c0a02fbed5e","Type":"ContainerStarted","Data":"9ad8a1ae30b43a3d44f8bac883cfbdd3efcf4cd919703214f50242e197172ac1"} Jun 11 19:22:52.737853 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.737832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqxnl" event={"ID":"0fd362c8-b36a-406b-8b00-02ea92528c15","Type":"ContainerStarted","Data":"d36e3ea5ddd56da45567fcc390d092c2025c886066459a41e1ec72b7358763e0"} Jun 11 19:22:52.738983 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:52.738930 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqspm" event={"ID":"95357c9a-ca54-44e6-85f5-049e1d925a1c","Type":"ContainerStarted","Data":"c60636495f93472f091d7cb65e462cebc359a7b0bb5836bfe102957841095d38"} Jun 11 19:22:53.283656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.283617 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:53.283848 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.283677 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:53.283848 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.283841 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:53.283957 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.283860 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:53.283957 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.283873 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:53.283957 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.283927 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:55.28391037 +0000 UTC m=+6.000018318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:53.284111 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.284083 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:53.284167 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.284149 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:55.284107761 +0000 UTC m=+6.000215705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:53.384726 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.384686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:53.384909 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.384889 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:53.384976 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.384956 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:55.384936821 +0000 UTC m=+6.101044766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:53.687384 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.687316 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 19:17:51 +0000 UTC" deadline="2028-01-15 17:41:45.953414694 +0000 UTC" Jun 11 19:22:53.687384 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.687376 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13990h18m52.266042561s" Jun 11 19:22:53.716606 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.716579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:53.716801 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.716772 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:22:53.716876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.716792 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:53.716980 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.716931 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:22:53.716980 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.716953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:53.717158 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:53.717046 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:22:53.765454 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.765419 2562 generic.go:356] "Generic (PLEG): container finished" podID="6eea7193e37fd72ee4297798599520cf" containerID="aae680af657b1565d0a891545baca45e7aa2c571864a0e3e9c1b216955fe7cc5" exitCode=0 Jun 11 19:22:53.765649 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.765535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" event={"ID":"6eea7193e37fd72ee4297798599520cf","Type":"ContainerDied","Data":"aae680af657b1565d0a891545baca45e7aa2c571864a0e3e9c1b216955fe7cc5"} Jun 11 19:22:53.780815 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:53.780437 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-225.ec2.internal" podStartSLOduration=2.780417467 podStartE2EDuration="2.780417467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:22:52.748625825 +0000 UTC m=+3.464733789" watchObservedRunningTime="2026-06-11 19:22:53.780417467 +0000 UTC m=+4.496525437" Jun 11 19:22:54.774610 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:54.774575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" event={"ID":"6eea7193e37fd72ee4297798599520cf","Type":"ContainerStarted","Data":"eceaa970c4fe6fcaefff561c5613a3890c7fc0cd14e46eb2cd39cbe8a6b7d968"} Jun 11 19:22:54.792082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:54.791597 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-225.ec2.internal" podStartSLOduration=3.791576437 podStartE2EDuration="3.791576437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:22:54.790439757 +0000 UTC m=+5.506547723" watchObservedRunningTime="2026-06-11 19:22:54.791576437 +0000 UTC m=+5.507684402" Jun 11 19:22:55.303171 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.303131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:55.303339 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.303194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:55.303405 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303390 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:55.303455 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303412 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:55.303455 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303426 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:55.303554 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303501 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:22:59.303481129 +0000 UTC m=+10.019589075 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:55.303898 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303867 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:55.303975 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.303931 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:59.303918605 +0000 UTC m=+10.020026552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:55.403801 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.403760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:55.403965 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.403910 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:55.404030 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.403974 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:22:59.403957449 +0000 UTC m=+10.120065398 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:55.716567 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.715934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:55.716567 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.716058 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:22:55.716567 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.716401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:55.716567 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:55.716513 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:55.716567 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.716527 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:22:55.716943 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:55.716653 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:22:57.719127 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:57.719090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:57.719551 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:57.719214 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:22:57.719551 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:57.719281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:57.719551 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:57.719353 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:22:57.719551 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:57.719404 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:57.719551 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:57.719499 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:22:59.333845 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.333808 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.333863 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334041 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334059 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334071 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334128 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:07.334109553 +0000 UTC m=+18.050217517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334210 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:59.334373 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.334264 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:07.334251909 +0000 UTC m=+18.050359856 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:22:59.434570 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.434537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:59.434757 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.434663 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:59.434757 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.434710 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:07.434696853 +0000 UTC m=+18.150804797 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:22:59.716495 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.716447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:22:59.716643 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.716565 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:22:59.716643 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.716582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:22:59.716733 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.716668 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:22:59.716733 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:22:59.716691 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:22:59.716809 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:22:59.716758 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:01.716494 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:01.716441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:01.716494 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:01.716484 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:01.717090 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:01.716441 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:01.717090 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:01.716602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:01.717090 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:01.716704 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:01.717090 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:01.716759 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:03.715730 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:03.715692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:03.716186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:03.715710 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:03.716186 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:03.715819 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:03.716186 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:03.715909 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:03.716186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:03.715710 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:03.716186 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:03.716034 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:05.716318 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:05.716282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:05.716318 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:05.716304 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:05.716874 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:05.716303 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:05.716874 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:05.716410 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:05.716874 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:05.716508 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:05.716874 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:05.716607 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:06.799971 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.799762 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="8c376821e0ca7883d868b19d3a51cffbfd79c66cd25d9231811da4bfb6cf70d2" exitCode=0 Jun 11 19:23:06.800511 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.799811 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"8c376821e0ca7883d868b19d3a51cffbfd79c66cd25d9231811da4bfb6cf70d2"} Jun 11 19:23:06.801779 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.801752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9frqc" event={"ID":"1b6c30e3-7f49-4650-b7df-bf619477ddc2","Type":"ContainerStarted","Data":"31e21266e039856a242de505e79b4a3362db8cbf4a8a17ed6b0b7998fd9a44ca"} Jun 11 19:23:06.803362 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.803337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" event={"ID":"a1507e62-c144-4f9f-acf5-9c0a02fbed5e","Type":"ContainerStarted","Data":"4a8a0830f106aa3c18cf61a5d7bd8a7fa9c1dc34a79373af19a69032c3f81f3b"} Jun 11 19:23:06.805170 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.805148 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bqxnl" event={"ID":"0fd362c8-b36a-406b-8b00-02ea92528c15","Type":"ContainerStarted","Data":"7e3c4fce98079450cae0cf6eb98fa40b169eb6b5f687f60ecbfea4757acf217d"} Jun 11 19:23:06.806639 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.806618 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kqspm" event={"ID":"95357c9a-ca54-44e6-85f5-049e1d925a1c","Type":"ContainerStarted","Data":"f8a14eab46e446ceaaa4dcb52e6a8062cbd745fbd882911f508eebfe6c3c631d"} Jun 11 19:23:06.808384 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.808360 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rvbz5" event={"ID":"317c1c25-d853-424a-834d-b3dd30727248","Type":"ContainerStarted","Data":"111b3228ec4e0bf4930cfe22ed11c7e093471588ebbc31fa2f7a228612bdffc4"} Jun 11 19:23:06.809776 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.809755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2x6j2" event={"ID":"5f679210-6132-47f9-a853-9bf0db227eab","Type":"ContainerStarted","Data":"115a6ec2af826a4100bcdeac44f69183e53cde5b7d0227b2d15e2986c231e825"} Jun 11 19:23:06.836008 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.835967 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2x6j2" podStartSLOduration=8.325592581 podStartE2EDuration="17.835954889s" totalImagesPullingTime="9.510362308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:06.835593865 +0000 UTC m=+17.551701829" watchObservedRunningTime="2026-06-11 19:23:06.835954889 +0000 UTC m=+17.552062853" Jun 11 19:23:06.850145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.850112 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rvbz5" podStartSLOduration=4.454511149 podStartE2EDuration="17.850100945s" totalImagesPullingTime="13.395589796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:06.849672117 +0000 UTC m=+17.565780082" watchObservedRunningTime="2026-06-11 19:23:06.850100945 +0000 UTC m=+17.566208910" Jun 11 19:23:06.865568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.865526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kqspm" podStartSLOduration=4.323855023 podStartE2EDuration="17.865515521s" totalImagesPullingTime="13.541660498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:06.865384057 +0000 UTC m=+17.581492021" watchObservedRunningTime="2026-06-11 19:23:06.865515521 +0000 UTC m=+17.581623485" Jun 11 19:23:06.878927 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.878890 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-bqxnl" podStartSLOduration=4.492830818 podStartE2EDuration="17.878879799s" totalImagesPullingTime="13.386048981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:06.878778475 +0000 UTC m=+17.594886440" watchObservedRunningTime="2026-06-11 19:23:06.878879799 +0000 UTC m=+17.594987764" Jun 11 19:23:06.895513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:06.895480 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9frqc" podStartSLOduration=4.476963352 podStartE2EDuration="17.895449732s" totalImagesPullingTime="13.41848638s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:06.89517523 +0000 UTC m=+17.611283194" watchObservedRunningTime="2026-06-11 19:23:06.895449732 +0000 UTC m=+17.611557696" Jun 11 19:23:07.394405 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.394377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:07.394405 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.394413 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:07.394585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394533 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:07.394585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394537 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:23:07.394585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394557 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:23:07.394585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394566 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:07.394714 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394589 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:23.394574902 +0000 UTC m=+34.110682845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:07.394714 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.394607 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:23.394595599 +0000 UTC m=+34.110703541 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:07.494948 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.494919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:07.495105 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.495038 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:07.495105 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.495100 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:23.495081365 +0000 UTC m=+34.211189314 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:07.716258 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.716222 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:07.716390 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.716232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:07.716390 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.716358 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:07.716535 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.716236 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:07.716535 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.716417 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:07.716535 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:07.716514 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:07.734982 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.734737 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 19:23:07.813084 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.813055 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nhn5w" event={"ID":"5c04613d-f963-49c3-bcdc-134f64d303fc","Type":"ContainerStarted","Data":"592390706ee5d3d6d4a76843a8e2c3e1f86eed3fb6cdc3cd523f882276e88076"} Jun 11 19:23:07.814753 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.814725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" event={"ID":"a1507e62-c144-4f9f-acf5-9c0a02fbed5e","Type":"ContainerStarted","Data":"2f52e431ff90f09bff94055f4f88afe1c0c8d0fcbabc24cada3330efe394f3c8"} Jun 11 19:23:07.829168 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:07.829132 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nhn5w" podStartSLOduration=5.442027172 podStartE2EDuration="18.829118556s" totalImagesPullingTime="13.387091384s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:07.82904436 +0000 UTC m=+18.545152326" watchObservedRunningTime="2026-06-11 19:23:07.829118556 +0000 UTC m=+18.545226550" Jun 11 19:23:08.711697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:08.711577 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T19:23:07.734752725Z","UUID":"79673f90-6d82-44cc-ba69-eac4d500fb1c","Handler":null,"Name":"","Endpoint":""} Jun 11 19:23:08.713409 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:08.713385 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 19:23:08.713550 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:08.713428 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 19:23:09.330210 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.330171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:09.492950 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.492903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:09.592430 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.592347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:09.715713 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.715679 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:09.715857 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:09.715813 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:09.715972 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.715943 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:09.716113 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:09.716046 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:09.716869 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.716853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:09.716935 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:09.716917 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:09.821644 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.821611 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" event={"ID":"a1507e62-c144-4f9f-acf5-9c0a02fbed5e","Type":"ContainerStarted","Data":"23ede6d80affbe35ce2a3e785d3f0ac74974a614a95571660e187a75215dfb3e"} Jun 11 19:23:09.840116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:09.840067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-chblc" podStartSLOduration=8.880118531 podStartE2EDuration="20.840046141s" totalImagesPullingTime="11.95992761s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:09.839705098 +0000 UTC m=+20.555813066" watchObservedRunningTime="2026-06-11 19:23:09.840046141 +0000 UTC m=+20.556154109" Jun 11 19:23:10.368474 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:10.368233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:10.425030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:10.424987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:11.343010 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.342979 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:23:11.343412 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.343378 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:23:11.720096 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.720059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:11.720096 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.720081 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:11.720666 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.720088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:11.720666 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:11.720156 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:11.720666 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:11.720271 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:11.720666 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:11.720394 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:11.825712 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.825681 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:23:11.826412 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.826392 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2x6j2" Jun 11 19:23:11.884139 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:11.884104 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:12.948589 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:12.948550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:13.002268 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:13.002231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:13.298043 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:13.297955 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:13.719379 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:13.719323 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:13.719585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:13.719447 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:13.719585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:13.719448 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:13.719585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:13.719453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:13.719585 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:13.719558 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:13.719775 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:13.719633 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:15.716613 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:15.716573 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:15.716613 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:15.716596 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:15.717080 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:15.716597 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:15.717080 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:15.716681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:15.717080 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:15.716795 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:15.717080 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:15.716882 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:16.835923 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.835756 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:23:16.836234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.836148 2562 generic.go:356] "Generic (PLEG): container finished" podID="45ab4f29-c98f-4841-a3fe-80f84c19ad6b" containerID="dfca0b3991b9fc8afdb456b0d7dcc6b2d56281ffa6fff27c3eec768a7287b5fe" exitCode=1 Jun 11 19:23:16.836234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.836213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"f239c7d404236c14e0617478c5a780a0c8c7b57ea5f36dee7786b522711de866"} Jun 11 19:23:16.836334 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.836323 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"479a828395403f10df3afd6f20cf13cbe5e89deb8ae9606cfa0081256c56def5"} Jun 11 19:23:16.836387 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.836357 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerDied","Data":"dfca0b3991b9fc8afdb456b0d7dcc6b2d56281ffa6fff27c3eec768a7287b5fe"} Jun 11 19:23:16.836436 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.836401 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"40063ee1d6b9deddcdcad6e4a31557f24a5aa93be3ebb7f6dbfc51cda335fa91"} Jun 11 19:23:16.838012 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.837989 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="1b8c1fdecef00e0466b752e0ad358a91f9cf0e79dd81707c0b5b2c6c4a525054" exitCode=0 Jun 11 19:23:16.838108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:16.838027 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"1b8c1fdecef00e0466b752e0ad358a91f9cf0e79dd81707c0b5b2c6c4a525054"} Jun 11 19:23:17.716719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.716692 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:17.716719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.716703 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:17.716955 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.716817 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:17.716955 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:17.716828 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:17.716955 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:17.716893 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:17.717057 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:17.716959 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:17.842253 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.842228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:23:17.842783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.842585 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"bdf3b7d1a525263fb125590c9ced88be52b6737b5918ca21661b2f084c9801da"} Jun 11 19:23:17.842783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:17.842642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"8a6ad20798e8f7a80632dae38a8ff1fb8fa393def6613330112e579dbf5910d2"} Jun 11 19:23:18.846144 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:18.846109 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="fefd9c35c1e2176103c710163bd79be877efce98f7beac536aab05728428f7c3" exitCode=0 Jun 11 19:23:18.846523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:18.846165 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"fefd9c35c1e2176103c710163bd79be877efce98f7beac536aab05728428f7c3"} Jun 11 19:23:19.717565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:19.717533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:19.717726 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:19.717661 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:19.717726 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:19.717695 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:19.717799 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:19.717738 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:19.717799 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:19.717761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:19.717866 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:19.717849 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:19.851299 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:19.851275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:23:19.851823 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:19.851638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"89ba237e3ef35738d1aefa865989d560e5f4781e7996b29d5b85ea03013806da"} Jun 11 19:23:20.856507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:20.856448 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="01a7f0c22d07db9d7502e1802db6878502c36d83778c4cd73d4a8efd86ab8267" exitCode=0 Jun 11 19:23:20.856937 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:20.856510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"01a7f0c22d07db9d7502e1802db6878502c36d83778c4cd73d4a8efd86ab8267"} Jun 11 19:23:21.072619 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.072574 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:21.273516 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.273489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:21.373946 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.373921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:21.716403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.716186 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:21.716582 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.716191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:21.716582 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:21.716521 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:21.716582 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.716191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:21.716756 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:21.716645 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:21.716756 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:21.716671 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:21.863136 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.863108 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:23:21.863580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.863555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"72a2ad6cd31bcea35914551a388bf56ff7c80fe38b81bb88c9ce1e618e1963ba"} Jun 11 19:23:21.863986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.863865 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:21.863986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.863935 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:21.864157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.864085 2562 scope.go:117] "RemoveContainer" containerID="dfca0b3991b9fc8afdb456b0d7dcc6b2d56281ffa6fff27c3eec768a7287b5fe" Jun 11 19:23:21.882677 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:21.882652 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:22.877268 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:22.877239 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:23:22.877760 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:22.877662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" event={"ID":"45ab4f29-c98f-4841-a3fe-80f84c19ad6b","Type":"ContainerStarted","Data":"1def1b68d1c2e36029d0b9ad87eca0c7a51251f90550915713509d95dddaad82"} Jun 11 19:23:22.878093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:22.878066 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:22.896171 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:22.896133 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:22.916121 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:22.916067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" podStartSLOduration=10.104045478 podStartE2EDuration="33.916047287s" totalImagesPullingTime="23.812001809s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:22.915196013 +0000 UTC m=+33.631303979" watchObservedRunningTime="2026-06-11 19:23:22.916047287 +0000 UTC m=+33.632155254" Jun 11 19:23:23.388398 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.388366 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cpl2n"] Jun 11 19:23:23.388649 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.388528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:23.388649 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.388638 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:23.389370 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.389342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nf6pg"] Jun 11 19:23:23.389501 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.389442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:23.389557 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.389538 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:23.391110 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.391086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2kjx"] Jun 11 19:23:23.391222 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.391191 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:23.391283 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.391268 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:23.418287 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.418218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:23.418287 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.418261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:23.418504 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.418414 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 19:23:23.418504 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.418431 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 19:23:23.418504 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.418443 2562 projected.go:196] Error preparing data for projected volume kube-api-access-lplwp for pod openshift-network-diagnostics/network-check-target-cpl2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:23.418658 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.418521 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp podName:de4924b6-43af-453d-8300-59712634624c nodeName:}" failed. No retries permitted until 2026-06-11 19:23:55.41850211 +0000 UTC m=+66.134610068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lplwp" (UniqueName: "kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp") pod "network-check-target-cpl2n" (UID: "de4924b6-43af-453d-8300-59712634624c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 19:23:23.419075 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.418979 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:23.419075 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.419051 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:55.419032093 +0000 UTC m=+66.135140038 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 19:23:23.519428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:23.519397 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:23.519591 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.519512 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:23.519591 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:23.519566 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret podName:d5bc9c87-26e2-4b39-becf-3d53b14a4977 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:55.519554482 +0000 UTC m=+66.235662425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret") pod "global-pull-secret-syncer-nf6pg" (UID: "d5bc9c87-26e2-4b39-becf-3d53b14a4977") : object "kube-system"/"original-pull-secret" not registered Jun 11 19:23:24.716616 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:24.716579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:24.717084 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:24.716710 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:25.716655 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:25.716624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:25.716998 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:25.716628 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:25.716998 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:25.716730 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:25.716998 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:25.716802 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:25.888777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:25.888745 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="202e514ae2e72e9812605352ce91e57022a8b92b35b0701b299962a488540434" exitCode=0 Jun 11 19:23:25.888924 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:25.888806 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"202e514ae2e72e9812605352ce91e57022a8b92b35b0701b299962a488540434"} Jun 11 19:23:26.636520 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:26.636456 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:26.692925 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:26.692898 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:26.715917 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:26.715900 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:26.715997 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:26.715982 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cpl2n" podUID="de4924b6-43af-453d-8300-59712634624c" Jun 11 19:23:26.893792 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:26.893719 2562 generic.go:356] "Generic (PLEG): container finished" podID="4298435a-2026-4105-8ece-f13f2c568c64" containerID="90b54c35dede3721219bc99d6110a611967a653687be394b749667820029e461" exitCode=0 Jun 11 19:23:26.893792 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:26.893760 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerDied","Data":"90b54c35dede3721219bc99d6110a611967a653687be394b749667820029e461"} Jun 11 19:23:27.426864 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:27.426822 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:27.715885 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:27.715794 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:27.716039 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:27.715802 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:27.716039 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:27.715900 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:23:27.716039 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:27.715992 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nf6pg" podUID="d5bc9c87-26e2-4b39-becf-3d53b14a4977" Jun 11 19:23:27.898811 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:27.898776 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" event={"ID":"4298435a-2026-4105-8ece-f13f2c568c64","Type":"ContainerStarted","Data":"27f5ddccee0ea00163364344016eba00b119928f9c2dcd2a7abc660a83453d97"} Jun 11 19:23:27.923685 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:27.923638 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6xwzk" podStartSLOduration=9.432568796 podStartE2EDuration="38.92362502s" totalImagesPullingTime="29.491056224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:27.923033679 +0000 UTC m=+38.639141643" watchObservedRunningTime="2026-06-11 19:23:27.92362502 +0000 UTC m=+38.639733012" Jun 11 19:23:28.054629 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.054557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.115001 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.114979 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.440676 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.440641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.499261 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.499233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.564665 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.564640 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-225.ec2.internal" event="NodeReady" Jun 11 19:23:28.564804 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.564749 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 19:23:28.607755 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.607728 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lcn49"] Jun 11 19:23:28.609618 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.609600 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.610947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.610927 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fknsp"] Jun 11 19:23:28.612093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.612069 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 19:23:28.612093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.612090 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j7vjf\"" Jun 11 19:23:28.612222 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.612081 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 19:23:28.612705 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.612689 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.614972 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.614955 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 19:23:28.615052 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.614986 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 19:23:28.615104 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.615071 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 19:23:28.615150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.615137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pnv6v\"" Jun 11 19:23:28.621058 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.621040 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lcn49"] Jun 11 19:23:28.625443 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.625418 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fknsp"] Jun 11 19:23:28.658097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f70d60f-4248-443f-8697-31ba61c09839-config-volume\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.658097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658100 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.658272 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-cert\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.658272 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7llvs\" (UniqueName: \"kubernetes.io/projected/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-kube-api-access-7llvs\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.658272 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658194 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f70d60f-4248-443f-8697-31ba61c09839-tmp-dir\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.658272 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.658262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdg57\" (UniqueName: \"kubernetes.io/projected/7f70d60f-4248-443f-8697-31ba61c09839-kube-api-access-kdg57\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.716275 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.716207 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:28.718984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.718968 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:23:28.719202 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.719190 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:23:28.719410 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.719392 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njf62\"" Jun 11 19:23:28.724375 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.724352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.759247 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759216 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f70d60f-4248-443f-8697-31ba61c09839-config-volume\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.759247 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-cert\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759288 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7llvs\" (UniqueName: \"kubernetes.io/projected/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-kube-api-access-7llvs\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759340 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f70d60f-4248-443f-8697-31ba61c09839-tmp-dir\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdg57\" (UniqueName: \"kubernetes.io/projected/7f70d60f-4248-443f-8697-31ba61c09839-kube-api-access-kdg57\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:28.759367 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:28.759429 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:28.759425 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:29.259404865 +0000 UTC m=+39.975512826 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:28.759724 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7f70d60f-4248-443f-8697-31ba61c09839-tmp-dir\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.759884 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.759862 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7f70d60f-4248-443f-8697-31ba61c09839-config-volume\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.763670 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.763649 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-cert\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.770807 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.770783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdg57\" (UniqueName: \"kubernetes.io/projected/7f70d60f-4248-443f-8697-31ba61c09839-kube-api-access-kdg57\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:28.770978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.770958 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7llvs\" (UniqueName: \"kubernetes.io/projected/bfdc7592-516f-46c3-b1a2-6f48bf4dbba3-kube-api-access-7llvs\") pod \"ingress-canary-fknsp\" (UID: \"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3\") " pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:28.825238 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.825215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:28.926071 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:28.926045 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fknsp" Jun 11 19:23:29.057348 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.057320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fknsp"] Jun 11 19:23:29.060767 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:23:29.060744 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfdc7592_516f_46c3_b1a2_6f48bf4dbba3.slice/crio-bd1a3ae3fc965fe10295e49a2c4be03cc1108d8921d9d7f85cf9b99a87407556 WatchSource:0}: Error finding container bd1a3ae3fc965fe10295e49a2c4be03cc1108d8921d9d7f85cf9b99a87407556: Status 404 returned error can't find the container with id bd1a3ae3fc965fe10295e49a2c4be03cc1108d8921d9d7f85cf9b99a87407556 Jun 11 19:23:29.263438 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.263234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:29.263438 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:29.263369 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:29.263616 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:29.263507 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:30.263488518 +0000 UTC m=+40.979596464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:29.717956 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.717918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:29.718252 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.718088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:29.721070 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.721047 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:23:29.721211 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.721188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xcc7p\"" Jun 11 19:23:29.721479 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.721448 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:23:29.905134 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:29.905095 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fknsp" event={"ID":"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3","Type":"ContainerStarted","Data":"bd1a3ae3fc965fe10295e49a2c4be03cc1108d8921d9d7f85cf9b99a87407556"} Jun 11 19:23:30.269746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:30.269715 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:30.270157 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:30.269852 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:30.270157 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:30.269929 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:32.269900109 +0000 UTC m=+42.986008052 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:31.910542 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:31.910513 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fknsp" event={"ID":"bfdc7592-516f-46c3-b1a2-6f48bf4dbba3","Type":"ContainerStarted","Data":"7662c57a5d6d4fbcac67efb28962a800bc8654de33ed8c9d4a6a2b2c114b6cef"} Jun 11 19:23:31.927782 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:31.927725 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fknsp" podStartSLOduration=2.033081061 podStartE2EDuration="3.927709108s" totalImagesPullingTime="1.894628047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:23:31.927650232 +0000 UTC m=+42.643758218" watchObservedRunningTime="2026-06-11 19:23:31.927709108 +0000 UTC m=+42.643817070" Jun 11 19:23:32.282804 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:32.282763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:32.282954 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:32.282907 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:32.282989 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:32.282971 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:36.282957289 +0000 UTC m=+46.999065236 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:34.194849 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:34.194821 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:34.249198 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:34.249171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:36.309519 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:36.309483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:36.309899 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:36.309632 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:36.309899 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:36.309696 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:23:44.309681456 +0000 UTC m=+55.025789409 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:39.755237 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:39.755195 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:39.807005 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:39.806970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:44.368069 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:44.368030 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:23:44.368497 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:44.368139 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:23:44.368497 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:44.368202 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:24:00.368188431 +0000 UTC m=+71.084296373 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:23:47.442514 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:47.442483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:47.506366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:47.506338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:54.894196 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:54.894165 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q99ll" Jun 11 19:23:55.015984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.015953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:55.097796 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.097748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:23:55.447797 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.447751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:23:55.447797 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.447800 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:55.450741 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.450724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 19:23:55.450795 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.450748 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 19:23:55.457982 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:55.457959 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:23:55.458083 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:23:55.458014 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:24:59.457997455 +0000 UTC m=+130.174105398 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : secret "metrics-daemon-secret" not found Jun 11 19:23:55.460158 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.460143 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 19:23:55.473050 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.473021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lplwp\" (UniqueName: \"kubernetes.io/projected/de4924b6-43af-453d-8300-59712634624c-kube-api-access-lplwp\") pod \"network-check-target-cpl2n\" (UID: \"de4924b6-43af-453d-8300-59712634624c\") " pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:55.548443 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.548419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:55.551048 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.551034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 19:23:55.561295 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.561272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5bc9c87-26e2-4b39-becf-3d53b14a4977-original-pull-secret\") pod \"global-pull-secret-syncer-nf6pg\" (UID: \"d5bc9c87-26e2-4b39-becf-3d53b14a4977\") " pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:55.727887 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.727810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njf62\"" Jun 11 19:23:55.735314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.735290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:23:55.836008 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.835980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nf6pg" Jun 11 19:23:55.855834 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.855803 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cpl2n"] Jun 11 19:23:55.858656 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:23:55.858627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde4924b6_43af_453d_8300_59712634624c.slice/crio-91ef70d0ea65bdfff4b0fc6b2bae4c7d431d5d5ec5a36fe6d78b873b4160cb06 WatchSource:0}: Error finding container 91ef70d0ea65bdfff4b0fc6b2bae4c7d431d5d5ec5a36fe6d78b873b4160cb06: Status 404 returned error can't find the container with id 91ef70d0ea65bdfff4b0fc6b2bae4c7d431d5d5ec5a36fe6d78b873b4160cb06 Jun 11 19:23:55.957373 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.957343 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nf6pg"] Jun 11 19:23:55.960404 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:23:55.960381 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bc9c87_26e2_4b39_becf_3d53b14a4977.slice/crio-6b796ad121b143ed319bb89e32e3227e4271f0a57d9b53c1744b2c5b79701e58 WatchSource:0}: Error finding container 6b796ad121b143ed319bb89e32e3227e4271f0a57d9b53c1744b2c5b79701e58: Status 404 returned error can't find the container with id 6b796ad121b143ed319bb89e32e3227e4271f0a57d9b53c1744b2c5b79701e58 Jun 11 19:23:55.966443 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.966416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nf6pg" event={"ID":"d5bc9c87-26e2-4b39-becf-3d53b14a4977","Type":"ContainerStarted","Data":"6b796ad121b143ed319bb89e32e3227e4271f0a57d9b53c1744b2c5b79701e58"} Jun 11 19:23:55.967410 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:23:55.967390 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cpl2n" event={"ID":"de4924b6-43af-453d-8300-59712634624c","Type":"ContainerStarted","Data":"91ef70d0ea65bdfff4b0fc6b2bae4c7d431d5d5ec5a36fe6d78b873b4160cb06"} Jun 11 19:24:00.382136 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:00.382103 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:24:00.382525 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:00.382256 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:24:00.382525 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:00.382322 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:24:32.382306198 +0000 UTC m=+103.098414145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:24:00.985312 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:00.985274 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nf6pg" event={"ID":"d5bc9c87-26e2-4b39-becf-3d53b14a4977","Type":"ContainerStarted","Data":"73ec558eb6b3f46fe3e12bf39802996bb20a346a210f76b1e0c055290f784953"} Jun 11 19:24:00.986650 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:00.986620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cpl2n" event={"ID":"de4924b6-43af-453d-8300-59712634624c","Type":"ContainerStarted","Data":"e9232fad92af1e7675aef8e50d793a95c01d0069414b5c2940ccf74b16f07407"} Jun 11 19:24:00.986783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:00.986754 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:24:01.000974 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:01.000929 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nf6pg" podStartSLOduration=66.767902023 podStartE2EDuration="1m11.000915219s" totalImagesPullingTime="4.233013196s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:24:01.000074852 +0000 UTC m=+71.716182843" watchObservedRunningTime="2026-06-11 19:24:01.000915219 +0000 UTC m=+71.717023183" Jun 11 19:24:01.015195 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:01.015152 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cpl2n" podStartSLOduration=67.690256934 podStartE2EDuration="1m12.015142638s" totalImagesPullingTime="4.324885704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:24:01.014851448 +0000 UTC m=+71.730959414" watchObservedRunningTime="2026-06-11 19:24:01.015142638 +0000 UTC m=+71.731250621" Jun 11 19:24:31.991944 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:31.991916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cpl2n" Jun 11 19:24:32.388010 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:32.387923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:24:32.388157 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:32.388043 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:24:32.388157 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:32.388096 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:36.388083333 +0000 UTC m=+167.104191277 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:24:59.473092 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:24:59.473058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:24:59.473553 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:59.473162 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 19:24:59.473553 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:24:59.473224 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs podName:0bf1a6fc-2154-4b49-8e85-5c4f248722d9 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:01.47321042 +0000 UTC m=+252.189318364 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs") pod "network-metrics-daemon-z2kjx" (UID: "0bf1a6fc-2154-4b49-8e85-5c4f248722d9") : secret "metrics-daemon-secret" not found Jun 11 19:25:21.575920 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:21.575884 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:31.620522 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:31.620423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lcn49" podUID="7f70d60f-4248-443f-8697-31ba61c09839" Jun 11 19:25:32.197825 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:32.197797 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcn49" Jun 11 19:25:32.730744 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:32.730711 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-z2kjx" podUID="0bf1a6fc-2154-4b49-8e85-5c4f248722d9" Jun 11 19:25:36.409535 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:36.409506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:25:36.409916 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:36.409611 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 19:25:36.409916 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:36.409668 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls podName:7f70d60f-4248-443f-8697-31ba61c09839 nodeName:}" failed. No retries permitted until 2026-06-11 19:27:38.409655146 +0000 UTC m=+289.125763089 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls") pod "dns-default-lcn49" (UID: "7f70d60f-4248-443f-8697-31ba61c09839") : secret "dns-default-metrics-tls" not found Jun 11 19:25:46.716399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:46.716366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:25:52.416480 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.416437 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4"] Jun 11 19:25:52.418330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.418311 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.421731 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.421712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 19:25:52.422037 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.422016 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-b56dn\"" Jun 11 19:25:52.422813 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.422800 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 19:25:52.422868 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.422823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.423153 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.423138 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.435272 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.435246 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4"] Jun 11 19:25:52.503621 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.503596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7335c92a-4a3b-4994-9682-5bfb2daacf1f-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.503706 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.503623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc5jt\" (UniqueName: \"kubernetes.io/projected/7335c92a-4a3b-4994-9682-5bfb2daacf1f-kube-api-access-cc5jt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.503706 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.503641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7335c92a-4a3b-4994-9682-5bfb2daacf1f-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.509631 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.509606 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2"] Jun 11 19:25:52.511244 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.511232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.513888 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.513866 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.513976 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.513870 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-59cf8\"" Jun 11 19:25:52.513976 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.513867 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 19:25:52.514116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.514102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 19:25:52.514193 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.514165 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.517768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.517744 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54979cc4fb-q6kvt"] Jun 11 19:25:52.519687 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.519673 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bv2mf"] Jun 11 19:25:52.519787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.519774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.521374 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.521358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.526391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.526375 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 19:25:52.528758 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.528740 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-lkfsn\"" Jun 11 19:25:52.528865 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.528774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.528983 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.528963 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 19:25:52.529049 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529002 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 19:25:52.529120 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529049 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5j582\"" Jun 11 19:25:52.529170 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529124 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.529228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529205 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 19:25:52.529378 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529361 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.529524 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529510 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 11 19:25:52.529771 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.529755 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2"] Jun 11 19:25:52.530094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.530079 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.530166 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.530124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 11 19:25:52.534155 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.534135 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 11 19:25:52.536525 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.536506 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bv2mf"] Jun 11 19:25:52.553785 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.553760 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54979cc4fb-q6kvt"] Jun 11 19:25:52.604555 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604529 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7335c92a-4a3b-4994-9682-5bfb2daacf1f-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.604683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604606 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-tmp\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.604683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc5jt\" (UniqueName: \"kubernetes.io/projected/7335c92a-4a3b-4994-9682-5bfb2daacf1f-kube-api-access-cc5jt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.604683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-serving-cert\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.604857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604687 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/771f19fd-750f-49ea-ae33-3430014200a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.604857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7335c92a-4a3b-4994-9682-5bfb2daacf1f-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.604857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604757 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-snapshots\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.604857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rs6pn\" (UniqueName: \"kubernetes.io/projected/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-kube-api-access-rs6pn\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.604857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604853 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-stats-auth\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604960 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/771f19fd-750f-49ea-ae33-3430014200a4-config\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.604983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dts8t\" (UniqueName: \"kubernetes.io/projected/771f19fd-750f-49ea-ae33-3430014200a4-kube-api-access-dts8t\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.605008 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.605052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.605077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-default-certificate\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.605137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.605099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpnlc\" (UniqueName: \"kubernetes.io/projected/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-kube-api-access-tpnlc\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.605377 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.605139 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7335c92a-4a3b-4994-9682-5bfb2daacf1f-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.607019 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.607001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7335c92a-4a3b-4994-9682-5bfb2daacf1f-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.609603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.609582 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc"] Jun 11 19:25:52.611735 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.611714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" Jun 11 19:25:52.612629 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.612607 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-p94gk"] Jun 11 19:25:52.614253 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.614240 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.614475 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.614438 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9qrkd\"" Jun 11 19:25:52.616968 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.616825 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 19:25:52.616968 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.616825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 19:25:52.617124 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.616972 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gmtvf\"" Jun 11 19:25:52.617306 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.617280 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:52.617404 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.617314 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 19:25:52.619366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.619346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc5jt\" (UniqueName: \"kubernetes.io/projected/7335c92a-4a3b-4994-9682-5bfb2daacf1f-kube-api-access-cc5jt\") pod \"kube-storage-version-migrator-operator-7c578b78fc-9xpb4\" (UID: \"7335c92a-4a3b-4994-9682-5bfb2daacf1f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.623323 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.623294 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 19:25:52.626665 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.626644 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc"] Jun 11 19:25:52.641620 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.641592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-p94gk"] Jun 11 19:25:52.705633 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-snapshots\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.705633 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705634 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rs6pn\" (UniqueName: \"kubernetes.io/projected/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-kube-api-access-rs6pn\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-stats-auth\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705700 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705719 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbrs\" (UniqueName: \"kubernetes.io/projected/69134959-67cb-4508-b521-e9995e372146-kube-api-access-jhbrs\") pod \"network-check-source-6947749cfc-x6xxc\" (UID: \"69134959-67cb-4508-b521-e9995e372146\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705788 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/771f19fd-750f-49ea-ae33-3430014200a4-config\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705812 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dts8t\" (UniqueName: \"kubernetes.io/projected/771f19fd-750f-49ea-ae33-3430014200a4-kube-api-access-dts8t\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.705881 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:52.705842 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:52.705917 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.205897803 +0000 UTC m=+183.922005768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705843 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.705967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:52.705994 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:53.205967465 +0000 UTC m=+183.922075428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-default-certificate\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpnlc\" (UniqueName: \"kubernetes.io/projected/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-kube-api-access-tpnlc\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-tmp\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706121 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-serving-cert\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.706255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/771f19fd-750f-49ea-ae33-3430014200a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.706607 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706352 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-snapshots\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.706607 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.707044 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706878 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-tmp\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.707044 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.706879 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:52.707263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.707182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/771f19fd-750f-49ea-ae33-3430014200a4-config\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.707408 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.707389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.708835 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.708799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-stats-auth\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.709060 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.709041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-default-certificate\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.709550 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.709532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/771f19fd-750f-49ea-ae33-3430014200a4-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.709672 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.709655 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-serving-cert\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.714439 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.714397 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rs6pn\" (UniqueName: \"kubernetes.io/projected/dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1-kube-api-access-rs6pn\") pod \"insights-operator-5bbd86d6bd-bv2mf\" (UID: \"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1\") " pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.714869 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.714796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dts8t\" (UniqueName: \"kubernetes.io/projected/771f19fd-750f-49ea-ae33-3430014200a4-kube-api-access-dts8t\") pod \"service-ca-operator-7ccbfd59dc-s8cv2\" (UID: \"771f19fd-750f-49ea-ae33-3430014200a4\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.716711 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.716689 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpnlc\" (UniqueName: \"kubernetes.io/projected/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-kube-api-access-tpnlc\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:52.727383 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.727368 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" Jun 11 19:25:52.806849 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.806820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-config\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.806984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.806871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx48r\" (UniqueName: \"kubernetes.io/projected/4159ac5a-c0b1-4fc6-9056-04df95039628-kube-api-access-hx48r\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.806984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.806906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4159ac5a-c0b1-4fc6-9056-04df95039628-serving-cert\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.806984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.806939 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-trusted-ca\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.807143 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.806985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbrs\" (UniqueName: \"kubernetes.io/projected/69134959-67cb-4508-b521-e9995e372146-kube-api-access-jhbrs\") pod \"network-check-source-6947749cfc-x6xxc\" (UID: \"69134959-67cb-4508-b521-e9995e372146\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" Jun 11 19:25:52.808625 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.808600 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:52.819412 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.819385 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" Jun 11 19:25:52.822646 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.822624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbrs\" (UniqueName: \"kubernetes.io/projected/69134959-67cb-4508-b521-e9995e372146-kube-api-access-jhbrs\") pod \"network-check-source-6947749cfc-x6xxc\" (UID: \"69134959-67cb-4508-b521-e9995e372146\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" Jun 11 19:25:52.834713 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.834688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" Jun 11 19:25:52.852846 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.852762 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4"] Jun 11 19:25:52.855153 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:25:52.855122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7335c92a_4a3b_4994_9682_5bfb2daacf1f.slice/crio-fda7257424c923e7014f74458d913efbc5ba3c878d36e1ab493e09bec14bd2e6 WatchSource:0}: Error finding container fda7257424c923e7014f74458d913efbc5ba3c878d36e1ab493e09bec14bd2e6: Status 404 returned error can't find the container with id fda7257424c923e7014f74458d913efbc5ba3c878d36e1ab493e09bec14bd2e6 Jun 11 19:25:52.908102 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.907981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-config\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.908102 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.908035 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx48r\" (UniqueName: \"kubernetes.io/projected/4159ac5a-c0b1-4fc6-9056-04df95039628-kube-api-access-hx48r\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.908102 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.908072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4159ac5a-c0b1-4fc6-9056-04df95039628-serving-cert\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.908102 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.908101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-trusted-ca\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.908811 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.908784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-config\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.909454 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.909205 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4159ac5a-c0b1-4fc6-9056-04df95039628-trusted-ca\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.911630 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.911601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4159ac5a-c0b1-4fc6-9056-04df95039628-serving-cert\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.917609 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.917581 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx48r\" (UniqueName: \"kubernetes.io/projected/4159ac5a-c0b1-4fc6-9056-04df95039628-kube-api-access-hx48r\") pod \"console-operator-5dbbb5d744-p94gk\" (UID: \"4159ac5a-c0b1-4fc6-9056-04df95039628\") " pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.926403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.926377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" Jun 11 19:25:52.931535 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.931509 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:25:52.958265 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.958173 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2"] Jun 11 19:25:52.962072 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:25:52.962042 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771f19fd_750f_49ea_ae33_3430014200a4.slice/crio-aed7a051e11eb4c95621014c1b4dacc5ba5fafada1e7efdb71201ff4fb73b1e5 WatchSource:0}: Error finding container aed7a051e11eb4c95621014c1b4dacc5ba5fafada1e7efdb71201ff4fb73b1e5: Status 404 returned error can't find the container with id aed7a051e11eb4c95621014c1b4dacc5ba5fafada1e7efdb71201ff4fb73b1e5 Jun 11 19:25:52.981487 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:52.981433 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-bv2mf"] Jun 11 19:25:53.070179 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.070159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-p94gk"] Jun 11 19:25:53.072019 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:25:53.071995 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4159ac5a_c0b1_4fc6_9056_04df95039628.slice/crio-b5394ecfb132454408194a3e9b9f3e6e5f6c31074091d995b883528c1bc80fd4 WatchSource:0}: Error finding container b5394ecfb132454408194a3e9b9f3e6e5f6c31074091d995b883528c1bc80fd4: Status 404 returned error can't find the container with id b5394ecfb132454408194a3e9b9f3e6e5f6c31074091d995b883528c1bc80fd4 Jun 11 19:25:53.082963 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.082939 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc"] Jun 11 19:25:53.084909 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:25:53.084885 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69134959_67cb_4508_b521_e9995e372146.slice/crio-f5ed2a0102c8b3d5596a60cfd40325f2a5828fb8800515acfb2314eb15b5340b WatchSource:0}: Error finding container f5ed2a0102c8b3d5596a60cfd40325f2a5828fb8800515acfb2314eb15b5340b: Status 404 returned error can't find the container with id f5ed2a0102c8b3d5596a60cfd40325f2a5828fb8800515acfb2314eb15b5340b Jun 11 19:25:53.209911 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.209838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:53.209911 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.209874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:53.210102 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:53.210000 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.209986059 +0000 UTC m=+184.926094015 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:25:53.210102 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:53.210008 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:25:53.210102 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:53.210063 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:54.210046694 +0000 UTC m=+184.926154646 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:25:53.246051 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.246016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" event={"ID":"4159ac5a-c0b1-4fc6-9056-04df95039628","Type":"ContainerStarted","Data":"b5394ecfb132454408194a3e9b9f3e6e5f6c31074091d995b883528c1bc80fd4"} Jun 11 19:25:53.247398 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.247375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" event={"ID":"69134959-67cb-4508-b521-e9995e372146","Type":"ContainerStarted","Data":"3b83291c43c0d4827e39435fdf63fa2931c867de0c734fd017f90d6a4d93d9dc"} Jun 11 19:25:53.247531 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.247417 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" event={"ID":"69134959-67cb-4508-b521-e9995e372146","Type":"ContainerStarted","Data":"f5ed2a0102c8b3d5596a60cfd40325f2a5828fb8800515acfb2314eb15b5340b"} Jun 11 19:25:53.248513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.248491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" event={"ID":"771f19fd-750f-49ea-ae33-3430014200a4","Type":"ContainerStarted","Data":"aed7a051e11eb4c95621014c1b4dacc5ba5fafada1e7efdb71201ff4fb73b1e5"} Jun 11 19:25:53.249570 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.249547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" event={"ID":"7335c92a-4a3b-4994-9682-5bfb2daacf1f","Type":"ContainerStarted","Data":"fda7257424c923e7014f74458d913efbc5ba3c878d36e1ab493e09bec14bd2e6"} Jun 11 19:25:53.250546 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.250523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" event={"ID":"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1","Type":"ContainerStarted","Data":"d1e30846baf963a6e1552cfab887c225702b4e58d1e972211b4562426a02f471"} Jun 11 19:25:53.264081 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:53.264035 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-x6xxc" podStartSLOduration=1.264023237 podStartE2EDuration="1.264023237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:25:53.263572735 +0000 UTC m=+183.979680693" watchObservedRunningTime="2026-06-11 19:25:53.264023237 +0000 UTC m=+183.980131203" Jun 11 19:25:54.217448 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:54.216907 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:54.217448 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:54.216958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:54.217448 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:54.217082 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:25:54.217448 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:54.217106 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.217085911 +0000 UTC m=+186.933193855 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:25:54.217448 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:54.217147 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:56.217129252 +0000 UTC m=+186.933237416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:25:54.768036 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:54.767890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:54.837593 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:54.837557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:56.230760 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:56.230714 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:56.231153 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:56.230773 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:25:56.231153 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:56.230866 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:25:56.231153 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:56.230908 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.230893523 +0000 UTC m=+190.947001465 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:25:56.231153 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:56.230937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.230923169 +0000 UTC m=+190.947031115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:25:57.269271 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.269233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" event={"ID":"771f19fd-750f-49ea-ae33-3430014200a4","Type":"ContainerStarted","Data":"0c167ed3db4271c60b06c38050e7e7f80f32a109bd49775b095d047ad840f22d"} Jun 11 19:25:57.270877 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.270845 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" event={"ID":"7335c92a-4a3b-4994-9682-5bfb2daacf1f","Type":"ContainerStarted","Data":"11a0f2ad89fc64cfac075bec36de242ceb08024fb91a9c1e0265ff520d2b3be1"} Jun 11 19:25:57.272305 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.272280 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" event={"ID":"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1","Type":"ContainerStarted","Data":"03daa4bdc3b39011b09f15833e4e911220fae4aad93a694bd33f2cb0d08b46c1"} Jun 11 19:25:57.274405 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.274386 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/0.log" Jun 11 19:25:57.274507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.274426 2562 generic.go:356] "Generic (PLEG): container finished" podID="4159ac5a-c0b1-4fc6-9056-04df95039628" containerID="9d8aaded51851c89a301206e835f84dd74e6086017a80ee5ffe5648058f5b0f9" exitCode=255 Jun 11 19:25:57.274507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.274455 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" event={"ID":"4159ac5a-c0b1-4fc6-9056-04df95039628","Type":"ContainerDied","Data":"9d8aaded51851c89a301206e835f84dd74e6086017a80ee5ffe5648058f5b0f9"} Jun 11 19:25:57.274682 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.274668 2562 scope.go:117] "RemoveContainer" containerID="9d8aaded51851c89a301206e835f84dd74e6086017a80ee5ffe5648058f5b0f9" Jun 11 19:25:57.286906 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.286860 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" podStartSLOduration=1.468050888 podStartE2EDuration="5.286845508s" totalImagesPullingTime="3.81879462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:25:57.286784896 +0000 UTC m=+188.002892864" watchObservedRunningTime="2026-06-11 19:25:57.286845508 +0000 UTC m=+188.002953471" Jun 11 19:25:57.320640 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.320593 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" podStartSLOduration=1.395135139 podStartE2EDuration="5.320578397s" totalImagesPullingTime="3.925443258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:25:57.320061683 +0000 UTC m=+188.036169651" watchObservedRunningTime="2026-06-11 19:25:57.320578397 +0000 UTC m=+188.036686365" Jun 11 19:25:57.337728 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:57.336442 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" podStartSLOduration=1.548033637 podStartE2EDuration="5.336412421s" totalImagesPullingTime="3.788378784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:25:57.336336389 +0000 UTC m=+188.052444355" watchObservedRunningTime="2026-06-11 19:25:57.336412421 +0000 UTC m=+188.052520384" Jun 11 19:25:58.284361 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.284332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:25:58.284821 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.284800 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/0.log" Jun 11 19:25:58.284878 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.284855 2562 generic.go:356] "Generic (PLEG): container finished" podID="4159ac5a-c0b1-4fc6-9056-04df95039628" containerID="d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375" exitCode=255 Jun 11 19:25:58.284930 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.284909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" event={"ID":"4159ac5a-c0b1-4fc6-9056-04df95039628","Type":"ContainerDied","Data":"d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375"} Jun 11 19:25:58.285021 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.285007 2562 scope.go:117] "RemoveContainer" containerID="9d8aaded51851c89a301206e835f84dd74e6086017a80ee5ffe5648058f5b0f9" Jun 11 19:25:58.285309 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.285214 2562 scope.go:117] "RemoveContainer" containerID="d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375" Jun 11 19:25:58.285419 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:58.285400 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-p94gk_openshift-console-operator(4159ac5a-c0b1-4fc6-9056-04df95039628)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" podUID="4159ac5a-c0b1-4fc6-9056-04df95039628" Jun 11 19:25:58.392677 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.392641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:58.480132 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.480094 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:58.730228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.730194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:58.911624 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.911595 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kxd6r"] Jun 11 19:25:58.914532 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.914507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:58.917072 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.917051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 19:25:58.917189 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.917075 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 19:25:58.917243 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.917195 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-746qd\"" Jun 11 19:25:58.925001 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.924980 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kxd6r"] Jun 11 19:25:58.945384 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.945348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:58.952381 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.952363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-crio-socket\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:58.952454 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.952393 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:58.952520 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.952490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbkmh\" (UniqueName: \"kubernetes.io/projected/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-api-access-hbkmh\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:58.952582 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.952567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-data-volume\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:58.952621 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:58.952593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.006497 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.006409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:59.053629 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-data-volume\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-crio-socket\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053797 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.053773 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.053797 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053786 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053872 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.053839 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:59.553817814 +0000 UTC m=+190.269925774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.053872 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.053865 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:25:59.053960 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053871 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-crio-socket\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053960 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.053870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbkmh\" (UniqueName: \"kubernetes.io/projected/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-api-access-hbkmh\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.053960 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.053910 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:25:59.553900146 +0000 UTC m=+190.270008089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : configmap "kube-rbac-proxy" not found Jun 11 19:25:59.054152 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.054136 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-data-volume\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.065036 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.065013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbkmh\" (UniqueName: \"kubernetes.io/projected/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-api-access-hbkmh\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.187025 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.186988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:59.249863 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.249834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:59.289824 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.289754 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:25:59.290254 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.290156 2562 scope.go:117] "RemoveContainer" containerID="d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375" Jun 11 19:25:59.290370 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.290348 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-p94gk_openshift-console-operator(4159ac5a-c0b1-4fc6-9056-04df95039628)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" podUID="4159ac5a-c0b1-4fc6-9056-04df95039628" Jun 11 19:25:59.376269 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.376236 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726"] Jun 11 19:25:59.379149 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.379131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" Jun 11 19:25:59.381744 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.381724 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 19:25:59.381909 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.381777 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 19:25:59.381909 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.381804 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-26lvc\"" Jun 11 19:25:59.389036 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.389006 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726"] Jun 11 19:25:59.439366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.439331 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:59.457580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.457547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h76d9\" (UniqueName: \"kubernetes.io/projected/2daecc80-10bc-4c68-acc2-22da73cff479-kube-api-access-h76d9\") pod \"migrator-d4bcd4867-v6726\" (UID: \"2daecc80-10bc-4c68-acc2-22da73cff479\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" Jun 11 19:25:59.536741 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.536711 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:25:59.558823 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.558753 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.558958 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.558852 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h76d9\" (UniqueName: \"kubernetes.io/projected/2daecc80-10bc-4c68-acc2-22da73cff479-kube-api-access-h76d9\") pod \"migrator-d4bcd4867-v6726\" (UID: \"2daecc80-10bc-4c68-acc2-22da73cff479\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" Jun 11 19:25:59.558958 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.558882 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:25:59.558958 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.558888 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:25:59.558958 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.558959 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.558941721 +0000 UTC m=+191.275049681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : configmap "kube-rbac-proxy" not found Jun 11 19:25:59.559160 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.559009 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.559160 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:25:59.559054 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:00.559042665 +0000 UTC m=+191.275150624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:25:59.567112 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.567083 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h76d9\" (UniqueName: \"kubernetes.io/projected/2daecc80-10bc-4c68-acc2-22da73cff479-kube-api-access-h76d9\") pod \"migrator-d4bcd4867-v6726\" (UID: \"2daecc80-10bc-4c68-acc2-22da73cff479\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" Jun 11 19:25:59.689222 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.689187 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" Jun 11 19:25:59.814446 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:25:59.814429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726"] Jun 11 19:25:59.816619 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:25:59.816592 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2daecc80_10bc_4c68_acc2_22da73cff479.slice/crio-3e1a201d268b044a52fc2504584e446a64eff785a4374671f3697e8d7f14b7fc WatchSource:0}: Error finding container 3e1a201d268b044a52fc2504584e446a64eff785a4374671f3697e8d7f14b7fc: Status 404 returned error can't find the container with id 3e1a201d268b044a52fc2504584e446a64eff785a4374671f3697e8d7f14b7fc Jun 11 19:26:00.264022 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.263991 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:00.264186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.264039 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:00.264186 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.264152 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:26:00.264289 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.264219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.264204034 +0000 UTC m=+198.980311976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:26:00.264289 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.264239 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:08.264225154 +0000 UTC m=+198.980333097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:26:00.293919 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.293883 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" event={"ID":"2daecc80-10bc-4c68-acc2-22da73cff479","Type":"ContainerStarted","Data":"3e1a201d268b044a52fc2504584e446a64eff785a4374671f3697e8d7f14b7fc"} Jun 11 19:26:00.565562 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.565446 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:00.565721 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.565575 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:00.565721 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.565605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:00.565721 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.565650 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:02.565629872 +0000 UTC m=+193.281737835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : configmap "kube-rbac-proxy" not found Jun 11 19:26:00.565721 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.565697 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:00.565932 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:00.565776 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:02.565765973 +0000 UTC m=+193.281873915 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:00.683954 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:00.683926 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqxnl_0fd362c8-b36a-406b-8b00-02ea92528c15/dns-node-resolver/0.log" Jun 11 19:26:01.083734 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:01.083702 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:01.140956 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:01.140915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:01.298913 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:01.298886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" event={"ID":"2daecc80-10bc-4c68-acc2-22da73cff479","Type":"ContainerStarted","Data":"9b6d8a70cd7e9cbfe81ea3ff9748a9860f3107192dc4afca7804f2f71fb7331a"} Jun 11 19:26:01.885174 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:01.885148 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rvbz5_317c1c25-d853-424a-834d-b3dd30727248/node-ca/0.log" Jun 11 19:26:02.000377 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.000347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:02.303622 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.303592 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" event={"ID":"2daecc80-10bc-4c68-acc2-22da73cff479","Type":"ContainerStarted","Data":"3e5a9d8d9eca4e9bd5348a66c089e6e3933fccaba4499cfba2de168ee664ddf2"} Jun 11 19:26:02.323653 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.323607 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-v6726" podStartSLOduration=1.9435539849999999 podStartE2EDuration="3.323592187s" totalImagesPullingTime="1.380038202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:02.321911678 +0000 UTC m=+193.038019646" watchObservedRunningTime="2026-06-11 19:26:02.323592187 +0000 UTC m=+193.039700176" Jun 11 19:26:02.584115 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.584046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:02.584115 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.584105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:02.584303 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:02.584174 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:02.584303 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:02.584195 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:02.584303 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:02.584261 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:06.584242422 +0000 UTC m=+197.300350443 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:02.584303 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:02.584281 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:06.584272044 +0000 UTC m=+197.300380000 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : configmap "kube-rbac-proxy" not found Jun 11 19:26:02.682681 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.682647 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fknsp_bfdc7592-516f-46c3-b1a2-6f48bf4dbba3/serve-healthcheck-canary/0.log" Jun 11 19:26:02.932562 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.932538 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:26:02.932699 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.932581 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:26:02.932910 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:02.932898 2562 scope.go:117] "RemoveContainer" containerID="d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375" Jun 11 19:26:02.933051 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:02.933033 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-p94gk_openshift-console-operator(4159ac5a-c0b1-4fc6-9056-04df95039628)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" podUID="4159ac5a-c0b1-4fc6-9056-04df95039628" Jun 11 19:26:04.569227 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:04.569191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.018417 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.018383 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.145317 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.145276 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.324042 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.323952 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.424048 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.424015 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.524790 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.524759 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:05.670191 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:05.670108 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:06.614712 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:06.614668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:06.614899 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:06.614776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:06.614899 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:06.614787 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 19:26:06.614899 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:06.614846 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.614830573 +0000 UTC m=+205.330938516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : configmap "kube-rbac-proxy" not found Jun 11 19:26:06.614899 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:06.614877 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:06.615038 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:06.614925 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:14.614909664 +0000 UTC m=+205.331017628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:06.660018 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:06.659987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:07.063062 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:07.063033 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:07.259777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:07.259744 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:07.458671 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:07.458631 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:07.653672 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:07.653638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:08.073099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.073070 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:08.328513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.328401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:08.328513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.328441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:08.328741 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:08.328561 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 19:26:08.328741 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:08.328590 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.32857288 +0000 UTC m=+215.044680826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : configmap references non-existent config key: service-ca.crt Jun 11 19:26:08.328741 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:08.328614 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs podName:2ff8f0d1-28e9-46e4-a593-9d1f3e482001 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:24.328599726 +0000 UTC m=+215.044707671 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs") pod "router-default-54979cc4fb-q6kvt" (UID: "2ff8f0d1-28e9-46e4-a593-9d1f3e482001") : secret "router-metrics-certs-default" not found Jun 11 19:26:08.458167 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.458130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:08.832386 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.832355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:08.888840 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:08.888796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:09.062097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:09.062062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:09.268046 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:09.268007 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:09.657002 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:09.656911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:09.857672 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:09.857641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:10.257257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:10.257225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:10.716514 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:10.716481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:11.054366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:11.054282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:11.458001 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:11.457970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:11.557634 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:11.557601 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:11.661471 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:11.661444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:12.059190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:12.059147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:12.460866 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:12.460816 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:12.858821 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:12.858737 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:12.959866 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:12.959839 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:13.016540 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:13.016510 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:13.262115 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:13.262086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:13.663789 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:13.663683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:13.863973 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:13.863942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:14.463433 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:14.463402 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:14.676548 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:14.676519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:14.676718 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:14.676572 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:14.676718 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:14.676678 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 19:26:14.676802 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:14.676742 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls podName:f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:30.676721825 +0000 UTC m=+221.392829768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kxd6r" (UID: "f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88") : secret "insights-runtime-extractor-tls" not found Jun 11 19:26:14.677090 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:14.677073 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:15.057185 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:15.057157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:15.253260 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:15.253225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:15.460675 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:15.460648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:15.657971 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:15.657944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:17.716099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:17.716071 2562 scope.go:117] "RemoveContainer" containerID="d142c0997bc364fac11c032211beb60c4c150d50bde4428ee5c4c9fbaf6c1375" Jun 11 19:26:18.352878 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.352850 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:26:18.353054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.352927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" event={"ID":"4159ac5a-c0b1-4fc6-9056-04df95039628","Type":"ContainerStarted","Data":"4ddb0df4cfdf6b142f24b073ea3cda87c4b75c765994f30f0a72186f4be548d0"} Jun 11 19:26:18.353207 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.353189 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:26:18.369986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.369939 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" podStartSLOduration=22.663728312 podStartE2EDuration="26.369925776s" totalImagesPullingTime="3.706197464s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:18.369072031 +0000 UTC m=+209.085179996" watchObservedRunningTime="2026-06-11 19:26:18.369925776 +0000 UTC m=+209.086033742" Jun 11 19:26:18.526455 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.526418 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-p94gk" Jun 11 19:26:18.698342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.698316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:18.799293 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.799259 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:18.856271 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:18.856233 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.006724 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.006634 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.386339 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.386251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.593071 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.593040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.783588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.783561 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.851381 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.851350 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:19.993958 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:19.993926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:20.057384 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:20.057309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:20.190518 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:20.190491 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:20.401810 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:20.401732 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:20.555024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:20.554985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:21.209892 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:21.209864 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:21.280727 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:21.280694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:21.568724 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:21.568653 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:24.352362 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.352330 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:24.352362 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.352365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:24.353071 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.353052 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-service-ca-bundle\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:24.354818 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.354796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2ff8f0d1-28e9-46e4-a593-9d1f3e482001-metrics-certs\") pod \"router-default-54979cc4fb-q6kvt\" (UID: \"2ff8f0d1-28e9-46e4-a593-9d1f3e482001\") " pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:24.629102 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.629016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:24.760984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:24.760956 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54979cc4fb-q6kvt"] Jun 11 19:26:24.764076 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:24.764048 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ff8f0d1_28e9_46e4_a593_9d1f3e482001.slice/crio-b6bf3b722b90e53d7f6a1f9f98a18615e6cfe0cc970599bbda2cbc94fdc06474 WatchSource:0}: Error finding container b6bf3b722b90e53d7f6a1f9f98a18615e6cfe0cc970599bbda2cbc94fdc06474: Status 404 returned error can't find the container with id b6bf3b722b90e53d7f6a1f9f98a18615e6cfe0cc970599bbda2cbc94fdc06474 Jun 11 19:26:25.160091 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.160062 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-846cc7455f-2m2xx"] Jun 11 19:26:25.162393 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.162378 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.167850 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.167813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 19:26:25.168013 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.167816 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 19:26:25.168013 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.167952 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 19:26:25.168320 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.168295 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wwnxb\"" Jun 11 19:26:25.175732 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.175712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 19:26:25.178448 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.178428 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846cc7455f-2m2xx"] Jun 11 19:26:25.189884 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.189857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:25.259206 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa291a1-8a83-4926-9803-d12297178384-ca-trust-extracted\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-registry-certificates\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-image-registry-private-configuration\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259283 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-bound-sa-token\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259306 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-trusted-ca\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259442 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvjg\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-kube-api-access-jfvjg\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259442 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259364 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-registry-tls\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.259442 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.259405 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-installation-pull-secrets\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.285571 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.285534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:25.360366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa291a1-8a83-4926-9803-d12297178384-ca-trust-extracted\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360385 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-registry-certificates\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360514 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-image-registry-private-configuration\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-bound-sa-token\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360591 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-trusted-ca\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvjg\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-kube-api-access-jfvjg\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.360723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360675 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-registry-tls\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.361054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360731 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-installation-pull-secrets\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.361054 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.360770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/cfa291a1-8a83-4926-9803-d12297178384-ca-trust-extracted\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.361291 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.361273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-registry-certificates\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.361705 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.361683 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/cfa291a1-8a83-4926-9803-d12297178384-trusted-ca\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.363245 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.363226 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-installation-pull-secrets\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.363655 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.363624 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/cfa291a1-8a83-4926-9803-d12297178384-image-registry-private-configuration\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.363832 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.363809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-registry-tls\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.369441 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.369419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvjg\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-kube-api-access-jfvjg\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.370042 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.370018 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cfa291a1-8a83-4926-9803-d12297178384-bound-sa-token\") pod \"image-registry-846cc7455f-2m2xx\" (UID: \"cfa291a1-8a83-4926-9803-d12297178384\") " pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.374779 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.374740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" event={"ID":"2ff8f0d1-28e9-46e4-a593-9d1f3e482001","Type":"ContainerStarted","Data":"f787179ebe8ff64bac2e1c4547f457956f798793042adde1f6a986b1a40d3a6d"} Jun 11 19:26:25.374865 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.374803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" event={"ID":"2ff8f0d1-28e9-46e4-a593-9d1f3e482001","Type":"ContainerStarted","Data":"b6bf3b722b90e53d7f6a1f9f98a18615e6cfe0cc970599bbda2cbc94fdc06474"} Jun 11 19:26:25.393609 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.393564 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" podStartSLOduration=33.393548593 podStartE2EDuration="33.393548593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:25.393114906 +0000 UTC m=+216.109222871" watchObservedRunningTime="2026-06-11 19:26:25.393548593 +0000 UTC m=+216.109656604" Jun 11 19:26:25.472952 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.472918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:25.602689 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.602596 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846cc7455f-2m2xx"] Jun 11 19:26:25.604527 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:25.604502 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa291a1_8a83_4926_9803_d12297178384.slice/crio-c58a6a13844a0304ba466696b67c435011f4ba4c1d268419e62303e2132bfc1f WatchSource:0}: Error finding container c58a6a13844a0304ba466696b67c435011f4ba4c1d268419e62303e2132bfc1f: Status 404 returned error can't find the container with id c58a6a13844a0304ba466696b67c435011f4ba4c1d268419e62303e2132bfc1f Jun 11 19:26:25.629199 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.629179 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:25.631650 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:25.631632 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:26.379506 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.379440 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" event={"ID":"cfa291a1-8a83-4926-9803-d12297178384","Type":"ContainerStarted","Data":"e9f6a267dd5566988c1e398a1091b790e4a09de76568e57497e421d4fc4b7665"} Jun 11 19:26:26.379951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.379525 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" event={"ID":"cfa291a1-8a83-4926-9803-d12297178384","Type":"ContainerStarted","Data":"c58a6a13844a0304ba466696b67c435011f4ba4c1d268419e62303e2132bfc1f"} Jun 11 19:26:26.379951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.379743 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:26:26.379951 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.379780 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:26.381056 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.380989 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54979cc4fb-q6kvt" Jun 11 19:26:26.400628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:26.400590 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podStartSLOduration=1.400576446 podStartE2EDuration="1.400576446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:26.399632475 +0000 UTC m=+217.115740442" watchObservedRunningTime="2026-06-11 19:26:26.400576446 +0000 UTC m=+217.116684410" Jun 11 19:26:27.055666 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.055627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:27.158341 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.158303 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:27.231587 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.231557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:27.365526 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.365427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:27.883868 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.883838 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:27.984768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:27.984741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:30.254529 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.254490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:30.344625 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.344595 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn"] Jun 11 19:26:30.347572 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.347555 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.351597 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.351574 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 19:26:30.351726 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.351602 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 11 19:26:30.351726 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.351670 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 11 19:26:30.352656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.352633 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 19:26:30.352787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.352640 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 19:26:30.352787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.352696 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-q2924\"" Jun 11 19:26:30.371412 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.371382 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn"] Jun 11 19:26:30.375099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.375068 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:30.483376 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.483345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:30.499379 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.499355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2156a1c-81ae-43b8-a378-dacc57bf18bc-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.499516 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.499390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhxkz\" (UniqueName: \"kubernetes.io/projected/a2156a1c-81ae-43b8-a378-dacc57bf18bc-kube-api-access-nhxkz\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.499516 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.499417 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.499516 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.499494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.600038 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.599958 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.600038 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.600010 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.600234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.600064 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2156a1c-81ae-43b8-a378-dacc57bf18bc-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.600234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.600096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhxkz\" (UniqueName: \"kubernetes.io/projected/a2156a1c-81ae-43b8-a378-dacc57bf18bc-kube-api-access-nhxkz\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.600778 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.600758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2156a1c-81ae-43b8-a378-dacc57bf18bc-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.602572 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.602549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.602744 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.602721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2156a1c-81ae-43b8-a378-dacc57bf18bc-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.609398 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.609368 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhxkz\" (UniqueName: \"kubernetes.io/projected/a2156a1c-81ae-43b8-a378-dacc57bf18bc-kube-api-access-nhxkz\") pod \"prometheus-operator-864fcfc6f9-cpcjn\" (UID: \"a2156a1c-81ae-43b8-a378-dacc57bf18bc\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.656715 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.656682 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" Jun 11 19:26:30.701267 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.701226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:30.704534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.704510 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kxd6r\" (UID: \"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88\") " pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:30.724190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.724169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kxd6r" Jun 11 19:26:30.788258 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.788231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn"] Jun 11 19:26:30.790878 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:30.790853 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2156a1c_81ae_43b8_a378_dacc57bf18bc.slice/crio-117b9dcdfa98d35dc5266acd8e069d0a78ddd110f24209c1d0892d35114a33d0 WatchSource:0}: Error finding container 117b9dcdfa98d35dc5266acd8e069d0a78ddd110f24209c1d0892d35114a33d0: Status 404 returned error can't find the container with id 117b9dcdfa98d35dc5266acd8e069d0a78ddd110f24209c1d0892d35114a33d0 Jun 11 19:26:30.849648 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:30.849622 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kxd6r"] Jun 11 19:26:30.851916 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:30.851860 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d481ff_ec8e_415f_a1a3_5e5ffadbbc88.slice/crio-436a906c7b69d50cc9dc7848499b84a0ed940c8de379cdbb5cc8f0c75de38473 WatchSource:0}: Error finding container 436a906c7b69d50cc9dc7848499b84a0ed940c8de379cdbb5cc8f0c75de38473: Status 404 returned error can't find the container with id 436a906c7b69d50cc9dc7848499b84a0ed940c8de379cdbb5cc8f0c75de38473 Jun 11 19:26:31.400843 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:31.400677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" event={"ID":"a2156a1c-81ae-43b8-a378-dacc57bf18bc","Type":"ContainerStarted","Data":"117b9dcdfa98d35dc5266acd8e069d0a78ddd110f24209c1d0892d35114a33d0"} Jun 11 19:26:31.402860 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:31.402831 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxd6r" event={"ID":"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88","Type":"ContainerStarted","Data":"436a906c7b69d50cc9dc7848499b84a0ed940c8de379cdbb5cc8f0c75de38473"} Jun 11 19:26:31.819955 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:31.819901 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:31.881868 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:31.881832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:32.408112 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:32.408078 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" event={"ID":"a2156a1c-81ae-43b8-a378-dacc57bf18bc","Type":"ContainerStarted","Data":"5d6b991e63de91118bf5e074fe4e6d97886d01fa6edad572cf13e4e1c4d14a46"} Jun 11 19:26:32.408510 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:32.408132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" event={"ID":"a2156a1c-81ae-43b8-a378-dacc57bf18bc","Type":"ContainerStarted","Data":"ebdaf1b33daf7c4f82b189b8f99e2ac119a354040a540e51c12b6109e33e4ef1"} Jun 11 19:26:32.488634 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:32.488549 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.422204 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.422171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.607177 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.607148 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.708670 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.708630 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.738188 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.738141 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-cpcjn" podStartSLOduration=3.326027333 podStartE2EDuration="4.738126135s" totalImagesPullingTime="1.412098802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:32.426918841 +0000 UTC m=+223.143026806" watchObservedRunningTime="2026-06-11 19:26:34.738126135 +0000 UTC m=+225.454234099" Jun 11 19:26:34.738429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.738407 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-n4wz7"] Jun 11 19:26:34.740756 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.740741 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.743451 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.743432 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 19:26:34.743920 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.743896 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 19:26:34.744027 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.743900 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-b527p\"" Jun 11 19:26:34.744407 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.744385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 19:26:34.804027 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.804000 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.839788 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.839764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-wtmp\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.839914 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.839803 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.839914 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.839832 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-sys\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840008 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.839927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840008 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.839965 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-root\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840104 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.840007 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840104 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.840078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swdxd\" (UniqueName: \"kubernetes.io/projected/86895bd1-1da9-4f07-bd3f-f11a45806b90-kube-api-access-swdxd\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840216 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.840121 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-metrics-client-ca\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.840216 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.840158 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-textfile\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.915682 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.915645 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:34.940786 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940754 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.940967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940798 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-root\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.940967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-root\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.940967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.940967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940965 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swdxd\" (UniqueName: \"kubernetes.io/projected/86895bd1-1da9-4f07-bd3f-f11a45806b90-kube-api-access-swdxd\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941179 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.940990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-metrics-client-ca\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941179 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:34.941105 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 19:26:34.941179 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-textfile\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941179 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:34.941171 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls podName:86895bd1-1da9-4f07-bd3f-f11a45806b90 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:35.441150679 +0000 UTC m=+226.157258627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls") pod "node-exporter-n4wz7" (UID: "86895bd1-1da9-4f07-bd3f-f11a45806b90") : secret "node-exporter-tls" not found Jun 11 19:26:34.941392 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-wtmp\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941392 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941392 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-sys\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941392 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-sys\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941612 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-wtmp\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941612 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-accelerators-collector-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941612 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/86895bd1-1da9-4f07-bd3f-f11a45806b90-metrics-client-ca\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.941767 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.941720 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-textfile\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.943765 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.943744 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:34.950985 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:34.950941 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swdxd\" (UniqueName: \"kubernetes.io/projected/86895bd1-1da9-4f07-bd3f-f11a45806b90-kube-api-access-swdxd\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:35.014519 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.014451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:35.353492 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.353344 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:35.422305 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.422275 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxd6r" event={"ID":"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88","Type":"ContainerStarted","Data":"26077610deb8a37b3e0bb20899dec5f13c4ee8044712d444e2241ca6147f6024"} Jun 11 19:26:35.422711 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.422329 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxd6r" event={"ID":"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88","Type":"ContainerStarted","Data":"7044f0360a72fbebb683b664742bf45a4b73435cb26706c7493b542a20fefbf0"} Jun 11 19:26:35.444630 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.444601 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:35.444772 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:35.444728 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 19:26:35.444814 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:26:35.444777 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls podName:86895bd1-1da9-4f07-bd3f-f11a45806b90 nodeName:}" failed. No retries permitted until 2026-06-11 19:26:36.444762706 +0000 UTC m=+227.160870648 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls") pod "node-exporter-n4wz7" (UID: "86895bd1-1da9-4f07-bd3f-f11a45806b90") : secret "node-exporter-tls" not found Jun 11 19:26:35.563628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.563592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:35.677525 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.677495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:35.760270 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:35.760224 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:36.241019 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:36.240963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:36.452940 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:36.452912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:36.455702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:36.455675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/86895bd1-1da9-4f07-bd3f-f11a45806b90-node-exporter-tls\") pod \"node-exporter-n4wz7\" (UID: \"86895bd1-1da9-4f07-bd3f-f11a45806b90\") " pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:36.549659 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:36.549584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-n4wz7" Jun 11 19:26:36.671704 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:36.671673 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86895bd1_1da9_4f07_bd3f_f11a45806b90.slice/crio-f49795cbd7153db1f6f6a93be0db6f3d9eccafd23c929d939796dab724601283 WatchSource:0}: Error finding container f49795cbd7153db1f6f6a93be0db6f3d9eccafd23c929d939796dab724601283: Status 404 returned error can't find the container with id f49795cbd7153db1f6f6a93be0db6f3d9eccafd23c929d939796dab724601283 Jun 11 19:26:37.432502 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.432453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kxd6r" event={"ID":"f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88","Type":"ContainerStarted","Data":"3bf1be48339e9638db2776da876223b50055c93658a2f6696f88e3513367e3b7"} Jun 11 19:26:37.433757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.433724 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4wz7" event={"ID":"86895bd1-1da9-4f07-bd3f-f11a45806b90","Type":"ContainerStarted","Data":"f49795cbd7153db1f6f6a93be0db6f3d9eccafd23c929d939796dab724601283"} Jun 11 19:26:37.451970 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.451929 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kxd6r" podStartSLOduration=33.715002453 podStartE2EDuration="39.45191303s" totalImagesPullingTime="5.736910577s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 19:25:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:37.45049802 +0000 UTC m=+228.166605988" watchObservedRunningTime="2026-06-11 19:26:37.45191303 +0000 UTC m=+228.168020995" Jun 11 19:26:37.614311 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.614274 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:37.694236 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.694163 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:37.866702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:37.866666 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:38.439342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:38.439312 2562 generic.go:356] "Generic (PLEG): container finished" podID="86895bd1-1da9-4f07-bd3f-f11a45806b90" containerID="a8a73958a4cf7efc9952acf42d6636a1e88de6e9f587562cc7a1acbaee7d0cc5" exitCode=0 Jun 11 19:26:38.439537 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:38.439382 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4wz7" event={"ID":"86895bd1-1da9-4f07-bd3f-f11a45806b90","Type":"ContainerDied","Data":"a8a73958a4cf7efc9952acf42d6636a1e88de6e9f587562cc7a1acbaee7d0cc5"} Jun 11 19:26:39.443444 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.443407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:39.445911 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.445879 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4wz7" event={"ID":"86895bd1-1da9-4f07-bd3f-f11a45806b90","Type":"ContainerStarted","Data":"2d6b24725dc0e25aafa2220f1c13f32f14041d7e302d153ff9f8d94f49413c05"} Jun 11 19:26:39.446032 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.445938 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-n4wz7" event={"ID":"86895bd1-1da9-4f07-bd3f-f11a45806b90","Type":"ContainerStarted","Data":"e191d1c355e04d55f6a3fc49fb733160921978f018fd0424ccb9f2f92c72f944"} Jun 11 19:26:39.457192 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.457168 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xjk42"] Jun 11 19:26:39.461098 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.461077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.463652 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.463630 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 11 19:26:39.463760 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.463656 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fdz47\"" Jun 11 19:26:39.469345 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.469322 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xjk42"] Jun 11 19:26:39.473006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.472910 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-n4wz7" podStartSLOduration=3.986347609 podStartE2EDuration="5.472895134s" totalImagesPullingTime="1.413377033s" totalInitContainerRuntime="73.170492ms" isStatefulPod=true podCreationTimestamp="2026-06-11 19:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:39.471034045 +0000 UTC m=+230.187142010" watchObservedRunningTime="2026-06-11 19:26:39.472895134 +0000 UTC m=+230.189003144" Jun 11 19:26:39.513437 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.513406 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:39.578836 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.578802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6lwh8\" (UniqueName: \"kubernetes.io/projected/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-kube-api-access-6lwh8\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.579036 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.578931 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.680210 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.680182 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6lwh8\" (UniqueName: \"kubernetes.io/projected/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-kube-api-access-6lwh8\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.680371 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.680265 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.682800 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.682777 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.692903 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.692881 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6lwh8\" (UniqueName: \"kubernetes.io/projected/47f2ddea-9e67-4a5c-8069-c79dc8fab9fe-kube-api-access-6lwh8\") pod \"monitoring-plugin-589576dfc7-xjk42\" (UID: \"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.731157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.731055 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:39.770541 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.770517 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:39.895455 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:39.895430 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-xjk42"] Jun 11 19:26:39.897541 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:26:39.897512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47f2ddea_9e67_4a5c_8069_c79dc8fab9fe.slice/crio-e0833a32648b2634ace7687ca1f8a58f92483beaba8194b944e2c06280549b76 WatchSource:0}: Error finding container e0833a32648b2634ace7687ca1f8a58f92483beaba8194b944e2c06280549b76: Status 404 returned error can't find the container with id e0833a32648b2634ace7687ca1f8a58f92483beaba8194b944e2c06280549b76 Jun 11 19:26:40.450614 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:40.450581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" event={"ID":"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe","Type":"ContainerStarted","Data":"e0833a32648b2634ace7687ca1f8a58f92483beaba8194b944e2c06280549b76"} Jun 11 19:26:40.910112 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:40.910017 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:41.281670 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:41.281635 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:41.341447 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:41.341409 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:42.458603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:42.458568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" event={"ID":"47f2ddea-9e67-4a5c-8069-c79dc8fab9fe","Type":"ContainerStarted","Data":"45722fd205a83c8debf9e64e2a73d09d6ad1679253e42fb9bb9326103795517e"} Jun 11 19:26:42.459043 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:42.458768 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:42.463335 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:42.463315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" Jun 11 19:26:42.475993 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:42.475951 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-xjk42" podStartSLOduration=1.5836711129999999 podStartE2EDuration="3.475938611s" totalImagesPullingTime="1.892267498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:26:42.473965737 +0000 UTC m=+233.190073702" watchObservedRunningTime="2026-06-11 19:26:42.475938611 +0000 UTC m=+233.192046576" Jun 11 19:26:42.944238 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:42.944206 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:43.722123 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:43.722089 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:45.477914 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:45.477880 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:45.478291 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:45.477929 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:46.978667 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:46.978626 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:47.053267 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:47.053221 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:47.386276 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:47.386190 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:47.386276 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:47.386243 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:47.830947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:47.830905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:47.889723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:47.889689 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:51.395235 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:51.395198 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:55.477391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:55.477357 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:55.477968 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:55.477423 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:26:56.187356 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:56.187317 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:56.254626 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:56.254579 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:56.522082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:56.521988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:56.602635 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:56.602596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:26:57.385739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:57.385709 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:26:57.385917 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:26:57.385760 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:27:01.553050 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:01.553011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:27:01.555551 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:01.555526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0bf1a6fc-2154-4b49-8e85-5c4f248722d9-metrics-certs\") pod \"network-metrics-daemon-z2kjx\" (UID: \"0bf1a6fc-2154-4b49-8e85-5c4f248722d9\") " pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:27:01.720300 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:01.720264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xcc7p\"" Jun 11 19:27:01.728482 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:01.728443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-z2kjx" Jun 11 19:27:01.871737 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:01.871669 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-z2kjx"] Jun 11 19:27:01.878065 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:27:01.878025 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bf1a6fc_2154_4b49_8e85_5c4f248722d9.slice/crio-2c6bd9539b489a8ea5cd5cc8b51d51667cd6412c8bcdc3ec8908da2ccb8ef496 WatchSource:0}: Error finding container 2c6bd9539b489a8ea5cd5cc8b51d51667cd6412c8bcdc3ec8908da2ccb8ef496: Status 404 returned error can't find the container with id 2c6bd9539b489a8ea5cd5cc8b51d51667cd6412c8bcdc3ec8908da2ccb8ef496 Jun 11 19:27:02.529105 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:02.529064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2kjx" event={"ID":"0bf1a6fc-2154-4b49-8e85-5c4f248722d9","Type":"ContainerStarted","Data":"2c6bd9539b489a8ea5cd5cc8b51d51667cd6412c8bcdc3ec8908da2ccb8ef496"} Jun 11 19:27:03.148696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.148669 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:03.249422 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.249395 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:03.534110 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.534081 2562 generic.go:356] "Generic (PLEG): container finished" podID="dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1" containerID="03daa4bdc3b39011b09f15833e4e911220fae4aad93a694bd33f2cb0d08b46c1" exitCode=0 Jun 11 19:27:03.534265 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.534156 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" event={"ID":"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1","Type":"ContainerDied","Data":"03daa4bdc3b39011b09f15833e4e911220fae4aad93a694bd33f2cb0d08b46c1"} Jun 11 19:27:03.534569 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.534543 2562 scope.go:117] "RemoveContainer" containerID="03daa4bdc3b39011b09f15833e4e911220fae4aad93a694bd33f2cb0d08b46c1" Jun 11 19:27:03.535725 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.535704 2562 generic.go:356] "Generic (PLEG): container finished" podID="7335c92a-4a3b-4994-9682-5bfb2daacf1f" containerID="11a0f2ad89fc64cfac075bec36de242ceb08024fb91a9c1e0265ff520d2b3be1" exitCode=0 Jun 11 19:27:03.535813 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.535783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" event={"ID":"7335c92a-4a3b-4994-9682-5bfb2daacf1f","Type":"ContainerDied","Data":"11a0f2ad89fc64cfac075bec36de242ceb08024fb91a9c1e0265ff520d2b3be1"} Jun 11 19:27:03.536076 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.536057 2562 scope.go:117] "RemoveContainer" containerID="11a0f2ad89fc64cfac075bec36de242ceb08024fb91a9c1e0265ff520d2b3be1" Jun 11 19:27:03.537622 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.537600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2kjx" event={"ID":"0bf1a6fc-2154-4b49-8e85-5c4f248722d9","Type":"ContainerStarted","Data":"30e338344678a7c28b7d18eb21e462de6aa0cebd3969fa8ef95359dc82427bc6"} Jun 11 19:27:03.537690 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.537644 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-z2kjx" event={"ID":"0bf1a6fc-2154-4b49-8e85-5c4f248722d9","Type":"ContainerStarted","Data":"91bc56623741ffffc79cfc14ae31d7aceeb2becbe970c8187acd819d68a0eae2"} Jun 11 19:27:03.590065 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:03.589991 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-z2kjx" podStartSLOduration=253.56586348 podStartE2EDuration="4m14.589970278s" totalImagesPullingTime="1.024106798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:03.588322954 +0000 UTC m=+254.304430921" watchObservedRunningTime="2026-06-11 19:27:03.589970278 +0000 UTC m=+254.306078243" Jun 11 19:27:04.543545 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:04.543505 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-bv2mf" event={"ID":"dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1","Type":"ContainerStarted","Data":"c9bc99f0391b0209f6c9bb8f70997f8d79e0b49a26416e7267455e6cb9baf651"} Jun 11 19:27:04.545327 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:04.545303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-9xpb4" event={"ID":"7335c92a-4a3b-4994-9682-5bfb2daacf1f","Type":"ContainerStarted","Data":"6e0c6d81c0d28311c5a7b806f44d8bf38ce703fa3266293889fafcaf6fc816e7"} Jun 11 19:27:05.158435 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.158403 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:05.476898 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.476866 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:27:05.477046 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.476927 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:27:05.477046 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.476971 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:27:05.477511 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.477456 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"e9f6a267dd5566988c1e398a1091b790e4a09de76568e57497e421d4fc4b7665"} pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 19:27:05.481238 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.481212 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:27:05.481378 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:05.481250 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:27:06.158933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:06.158898 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:06.225110 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:06.225076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:06.496816 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:06.496784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:06.573517 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:06.573482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:08.654892 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:08.654861 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-xjk42_47f2ddea-9e67-4a5c-8069-c79dc8fab9fe/monitoring-plugin/0.log" Jun 11 19:27:10.055773 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:10.055746 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/init-textfile/0.log" Jun 11 19:27:10.256165 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:10.256136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/node-exporter/0.log" Jun 11 19:27:10.455040 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:10.455012 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/kube-rbac-proxy/0.log" Jun 11 19:27:12.656658 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:12.656623 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-cpcjn_a2156a1c-81ae-43b8-a378-dacc57bf18bc/prometheus-operator/0.log" Jun 11 19:27:12.854621 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:12.854588 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-cpcjn_a2156a1c-81ae-43b8-a378-dacc57bf18bc/kube-rbac-proxy/0.log" Jun 11 19:27:12.952812 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:12.952775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:13.022965 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:13.022935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:14.654579 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:14.654549 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:27:14.857116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:14.857088 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/2.log" Jun 11 19:27:15.481430 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:15.481395 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:27:15.481599 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:15.481452 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:27:15.684914 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:15.684882 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:16.855108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:16.855079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqxnl_0fd362c8-b36a-406b-8b00-02ea92528c15/dns-node-resolver/0.log" Jun 11 19:27:17.454910 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:17.454871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-846cc7455f-2m2xx_cfa291a1-8a83-4926-9803-d12297178384/registry/0.log" Jun 11 19:27:18.054927 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.054838 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rvbz5_317c1c25-d853-424a-834d-b3dd30727248/node-ca/0.log" Jun 11 19:27:18.454899 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.454871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 19:27:18.593880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.593851 2562 generic.go:356] "Generic (PLEG): container finished" podID="771f19fd-750f-49ea-ae33-3430014200a4" containerID="0c167ed3db4271c60b06c38050e7e7f80f32a109bd49775b095d047ad840f22d" exitCode=0 Jun 11 19:27:18.594040 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.593930 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" event={"ID":"771f19fd-750f-49ea-ae33-3430014200a4","Type":"ContainerDied","Data":"0c167ed3db4271c60b06c38050e7e7f80f32a109bd49775b095d047ad840f22d"} Jun 11 19:27:18.594287 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.594271 2562 scope.go:117] "RemoveContainer" containerID="0c167ed3db4271c60b06c38050e7e7f80f32a109bd49775b095d047ad840f22d" Jun 11 19:27:18.854664 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:18.854560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fknsp_bfdc7592-516f-46c3-b1a2-6f48bf4dbba3/serve-healthcheck-canary/0.log" Jun 11 19:27:19.600186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:19.600153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-s8cv2" event={"ID":"771f19fd-750f-49ea-ae33-3430014200a4","Type":"ContainerStarted","Data":"5cdf89746a7f9c2db62011efad592a3d4f3f12268af7d41b5f0c8babe11e074f"} Jun 11 19:27:25.242646 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:25.242611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:25.303250 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:25.303223 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:25.481857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:25.481829 2562 patch_prober.go:28] interesting pod/image-registry-846cc7455f-2m2xx container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 19:27:25.482012 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:25.481872 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 19:27:30.497104 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:30.497057 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" podUID="cfa291a1-8a83-4926-9803-d12297178384" containerName="registry" containerID="cri-o://e9f6a267dd5566988c1e398a1091b790e4a09de76568e57497e421d4fc4b7665" gracePeriod=30 Jun 11 19:27:31.641947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:31.641922 2562 generic.go:356] "Generic (PLEG): container finished" podID="cfa291a1-8a83-4926-9803-d12297178384" containerID="e9f6a267dd5566988c1e398a1091b790e4a09de76568e57497e421d4fc4b7665" exitCode=0 Jun 11 19:27:31.642244 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:31.641999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" event={"ID":"cfa291a1-8a83-4926-9803-d12297178384","Type":"ContainerDied","Data":"e9f6a267dd5566988c1e398a1091b790e4a09de76568e57497e421d4fc4b7665"} Jun 11 19:27:32.647724 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:32.647683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" event={"ID":"cfa291a1-8a83-4926-9803-d12297178384","Type":"ContainerStarted","Data":"dcc14d02c181e36343389f4aeceeae99e83009f4091df1f6587ae8b2289946d1"} Jun 11 19:27:32.648115 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:32.647786 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:27:33.498767 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:33.498732 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:33.599701 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:33.599676 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:33.661941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:33.661907 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:34.834063 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:34.834027 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:34.936289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:34.936235 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:35.198558 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:27:35.198498 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lcn49" podUID="7f70d60f-4248-443f-8697-31ba61c09839" Jun 11 19:27:35.657204 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:35.657121 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:38.434428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:38.434394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:38.436855 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:38.436828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7f70d60f-4248-443f-8697-31ba61c09839-metrics-tls\") pod \"dns-default-lcn49\" (UID: \"7f70d60f-4248-443f-8697-31ba61c09839\") " pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:38.660663 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:38.660632 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j7vjf\"" Jun 11 19:27:38.667946 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:38.667923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:38.798374 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:38.798342 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lcn49"] Jun 11 19:27:38.801832 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:27:38.801802 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f70d60f_4248_443f_8697_31ba61c09839.slice/crio-69e8e8d4e6923c54359c2477be23a20b97394100541cd40ba94827370a71227a WatchSource:0}: Error finding container 69e8e8d4e6923c54359c2477be23a20b97394100541cd40ba94827370a71227a: Status 404 returned error can't find the container with id 69e8e8d4e6923c54359c2477be23a20b97394100541cd40ba94827370a71227a Jun 11 19:27:39.673426 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:39.673375 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcn49" event={"ID":"7f70d60f-4248-443f-8697-31ba61c09839","Type":"ContainerStarted","Data":"69e8e8d4e6923c54359c2477be23a20b97394100541cd40ba94827370a71227a"} Jun 11 19:27:40.333692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:40.333655 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:40.679520 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:40.679493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcn49" event={"ID":"7f70d60f-4248-443f-8697-31ba61c09839","Type":"ContainerStarted","Data":"d6e7b94bdf52b3159120bb53ffbfac8caa4572463f80bbf485b4596c30039611"} Jun 11 19:27:41.418484 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:41.418425 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:41.685224 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:41.685193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lcn49" event={"ID":"7f70d60f-4248-443f-8697-31ba61c09839","Type":"ContainerStarted","Data":"ac7bc261ae7d1afd42b1e2980f8fc0c0f364f5b093b238864d4ddfa240eb4e2e"} Jun 11 19:27:41.685613 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:41.685319 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:41.876267 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:41.876235 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:41.976012 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:41.975932 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:42.150700 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:42.150670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:42.216063 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:42.216035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:49.666017 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:49.665987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:27:49.666492 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:49.666140 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:27:49.676792 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:49.676769 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:27:49.676937 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:49.676885 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:27:49.683337 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:49.683318 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 19:27:51.691667 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:51.691640 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lcn49" Jun 11 19:27:51.711423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:51.711377 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lcn49" podStartSLOduration=262.006556114 podStartE2EDuration="4m23.711363667s" totalImagesPullingTime="1.704807553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:23:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:27:41.726276156 +0000 UTC m=+292.442384121" watchObservedRunningTime="2026-06-11 19:27:51.711363667 +0000 UTC m=+302.427471632" Jun 11 19:27:53.655540 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:53.655510 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-846cc7455f-2m2xx" Jun 11 19:27:53.796266 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:53.796225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:53.903186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:53.903143 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:53.997482 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:53.997427 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:54.198857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:54.198817 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:54.400768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:54.400678 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:54.469440 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:54.469407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:57.957653 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:57.957622 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:58.058622 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:58.058594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:27:59.054923 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.054885 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-56486db9dc-r7s47"] Jun 11 19:27:59.058502 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.058476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.063142 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.063113 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 19:27:59.063429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.063411 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 19:27:59.063673 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.063657 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 19:27:59.063807 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.063715 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-gkzdj\"" Jun 11 19:27:59.064030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.064010 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 19:27:59.064357 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.064342 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 19:27:59.069358 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.069340 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 19:27:59.076908 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.076877 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56486db9dc-r7s47"] Jun 11 19:27:59.205122 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205122 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-serving-certs-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-federate-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjd7v\" (UniqueName: \"kubernetes.io/projected/ad1fad48-9e93-4f6a-a077-26c3e342bf81-kube-api-access-sjd7v\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205206 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-metrics-client-ca\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.205344 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.205313 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306528 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-serving-certs-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-federate-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjd7v\" (UniqueName: \"kubernetes.io/projected/ad1fad48-9e93-4f6a-a077-26c3e342bf81-kube-api-access-sjd7v\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-metrics-client-ca\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.306696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.306668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.307682 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.307652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-metrics-client-ca\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.307807 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.307789 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-serving-certs-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.308235 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.308210 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-trusted-ca-bundle\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.309354 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.309332 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.309433 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.309380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-telemeter-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.309667 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.309650 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-secret-telemeter-client\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.309713 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.309686 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ad1fad48-9e93-4f6a-a077-26c3e342bf81-federate-client-tls\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.318610 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.318588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjd7v\" (UniqueName: \"kubernetes.io/projected/ad1fad48-9e93-4f6a-a077-26c3e342bf81-kube-api-access-sjd7v\") pod \"telemeter-client-56486db9dc-r7s47\" (UID: \"ad1fad48-9e93-4f6a-a077-26c3e342bf81\") " pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.369759 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.369729 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" Jun 11 19:27:59.510232 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.510106 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-56486db9dc-r7s47"] Jun 11 19:27:59.512816 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:27:59.512789 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1fad48_9e93_4f6a_a077_26c3e342bf81.slice/crio-af3bac2526b027306a3ac8d02a1aadc0f6894e2e1cefb1c1ea7860f9c09b0386 WatchSource:0}: Error finding container af3bac2526b027306a3ac8d02a1aadc0f6894e2e1cefb1c1ea7860f9c09b0386: Status 404 returned error can't find the container with id af3bac2526b027306a3ac8d02a1aadc0f6894e2e1cefb1c1ea7860f9c09b0386 Jun 11 19:27:59.514893 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.514878 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:27:59.751034 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:27:59.750999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" event={"ID":"ad1fad48-9e93-4f6a-a077-26c3e342bf81","Type":"ContainerStarted","Data":"af3bac2526b027306a3ac8d02a1aadc0f6894e2e1cefb1c1ea7860f9c09b0386"} Jun 11 19:28:02.763116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:02.763081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" event={"ID":"ad1fad48-9e93-4f6a-a077-26c3e342bf81","Type":"ContainerStarted","Data":"ecb790e2c13cef632b21b51ae35fde573c2906fca158271ab3a4d490fcc16f5d"} Jun 11 19:28:02.901924 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:02.901897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:02.967710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:02.967675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:03.362984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:03.362942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:03.466371 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:03.466343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:03.768423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:03.768388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" event={"ID":"ad1fad48-9e93-4f6a-a077-26c3e342bf81","Type":"ContainerStarted","Data":"bb54596e471a93c5eff922b6f37ddf211a2708f2f62456abcc2fa69aec8ae8e5"} Jun 11 19:28:03.768915 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:03.768445 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" event={"ID":"ad1fad48-9e93-4f6a-a077-26c3e342bf81","Type":"ContainerStarted","Data":"1ad304c2a976d5cd984b7ea92b333762c6b63d108c07a08d7879b86840878295"} Jun 11 19:28:03.792614 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:03.792570 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-56486db9dc-r7s47" podStartSLOduration=0.92897319 podStartE2EDuration="4.792555475s" totalImagesPullingTime="3.863582285s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:27:59 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:28:03.791901639 +0000 UTC m=+314.508009615" watchObservedRunningTime="2026-06-11 19:28:03.792555475 +0000 UTC m=+314.508663439" Jun 11 19:28:04.720611 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:04.720577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:04.805441 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:04.805408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:12.955389 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:12.955349 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:13.018306 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:13.018277 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:15.548947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:15.548911 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:15.645229 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:15.645190 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:15.707283 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:15.707254 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:27.955314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:27.955225 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:28.018515 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:28.018486 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:34.262263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:34.262224 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:34.324960 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:34.324930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:38.742121 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:38.742081 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:28:38.817723 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:28:38.817690 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:10.856612 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:10.856578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:27.699538 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:27.699495 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:27.766283 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:27.766246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:39.630740 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:39.630702 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:39.745583 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:39.745545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:42.958780 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:42.958750 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:43.059346 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:43.059316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:43.273631 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:43.273548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:52.766757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:52.766727 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:29:52.864986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:29:52.864948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:04.031182 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:04.031143 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:04.132169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:04.132137 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:04.233525 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:04.233451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:06.822869 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:06.822833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:06.907333 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:06.907305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:16.245670 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:16.245632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:19.293593 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:19.293562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:19.377915 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:19.377868 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:24.854395 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:24.854353 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:24.951017 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:24.950982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:25.640775 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.640744 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r"] Jun 11 19:30:25.644179 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.644164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.646851 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.646822 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:30:25.647886 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.647865 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:30:25.648014 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.647903 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:30:25.653784 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.653764 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r"] Jun 11 19:30:25.786916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.786885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmhxv\" (UniqueName: \"kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.786916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.786915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.787111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.786951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.887647 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.887602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.888003 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.887674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmhxv\" (UniqueName: \"kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.888003 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.887692 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.888003 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.887987 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.888105 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.888019 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.897187 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.897130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmhxv\" (UniqueName: \"kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:25.954777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:25.954750 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:26.090242 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:26.085909 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r"] Jun 11 19:30:26.282247 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:26.282214 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" event={"ID":"5ed069b8-a000-4345-b899-6cf8fb75ce0b","Type":"ContainerStarted","Data":"3f71e1b21a8ed591de59cdd122ea06d4fc58b98354db816852cf43fd39f6f90e"} Jun 11 19:30:35.318907 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:35.318873 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerID="16e5654b76044760570efe4e075401aee120ece96a44fac5bfb509569c2331da" exitCode=0 Jun 11 19:30:35.319289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:35.318925 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" event={"ID":"5ed069b8-a000-4345-b899-6cf8fb75ce0b","Type":"ContainerDied","Data":"16e5654b76044760570efe4e075401aee120ece96a44fac5bfb509569c2331da"} Jun 11 19:30:38.331392 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:38.331362 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerID="752725c0b783ae3b747290abc8d04f62d0c6d47ee087c397043400fb8d849595" exitCode=0 Jun 11 19:30:38.331790 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:38.331397 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" event={"ID":"5ed069b8-a000-4345-b899-6cf8fb75ce0b","Type":"ContainerDied","Data":"752725c0b783ae3b747290abc8d04f62d0c6d47ee087c397043400fb8d849595"} Jun 11 19:30:47.370154 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:47.370073 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerID="67d25f06024b322e0f3f85d004ea73dde785ecf4774eaf146684934e0e3a7beb" exitCode=0 Jun 11 19:30:47.370503 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:47.370163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" event={"ID":"5ed069b8-a000-4345-b899-6cf8fb75ce0b","Type":"ContainerDied","Data":"67d25f06024b322e0f3f85d004ea73dde785ecf4774eaf146684934e0e3a7beb"} Jun 11 19:30:48.540479 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.540434 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:48.578220 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.578189 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle\") pod \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " Jun 11 19:30:48.578382 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.578362 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util\") pod \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " Jun 11 19:30:48.578441 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.578417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmhxv\" (UniqueName: \"kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv\") pod \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\" (UID: \"5ed069b8-a000-4345-b899-6cf8fb75ce0b\") " Jun 11 19:30:48.579035 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.579002 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle" (OuterVolumeSpecName: "bundle") pod "5ed069b8-a000-4345-b899-6cf8fb75ce0b" (UID: "5ed069b8-a000-4345-b899-6cf8fb75ce0b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:30:48.580711 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.580681 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv" (OuterVolumeSpecName: "kube-api-access-rmhxv") pod "5ed069b8-a000-4345-b899-6cf8fb75ce0b" (UID: "5ed069b8-a000-4345-b899-6cf8fb75ce0b"). InnerVolumeSpecName "kube-api-access-rmhxv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:30:48.582880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.582861 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util" (OuterVolumeSpecName: "util") pod "5ed069b8-a000-4345-b899-6cf8fb75ce0b" (UID: "5ed069b8-a000-4345-b899-6cf8fb75ce0b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:30:48.679768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.679744 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:30:48.679768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.679768 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5ed069b8-a000-4345-b899-6cf8fb75ce0b-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:30:48.679943 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:48.679778 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmhxv\" (UniqueName: \"kubernetes.io/projected/5ed069b8-a000-4345-b899-6cf8fb75ce0b-kube-api-access-rmhxv\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:30:49.380020 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:49.379989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" event={"ID":"5ed069b8-a000-4345-b899-6cf8fb75ce0b","Type":"ContainerDied","Data":"3f71e1b21a8ed591de59cdd122ea06d4fc58b98354db816852cf43fd39f6f90e"} Jun 11 19:30:49.380182 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:49.380023 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dm8p4r" Jun 11 19:30:49.380182 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:49.380035 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f71e1b21a8ed591de59cdd122ea06d4fc58b98354db816852cf43fd39f6f90e" Jun 11 19:30:51.675424 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:51.675386 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:52.512628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:52.512597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:55.503774 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:55.503731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:55.600840 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:55.600803 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:57.771252 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:57.771224 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:57.916101 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:57.916066 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:58.110536 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.110440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:58.270185 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.270144 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:30:58.390088 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390017 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb"] Jun 11 19:30:58.390288 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390277 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="util" Jun 11 19:30:58.390330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390290 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="util" Jun 11 19:30:58.390330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390306 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="pull" Jun 11 19:30:58.390330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390312 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="pull" Jun 11 19:30:58.390330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390320 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="extract" Jun 11 19:30:58.390330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390325 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="extract" Jun 11 19:30:58.390495 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.390380 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ed069b8-a000-4345-b899-6cf8fb75ce0b" containerName="extract" Jun 11 19:30:58.392568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.392552 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.395085 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.395065 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:30:58.395985 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.395969 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:30:58.396071 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.395975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:30:58.407829 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.407808 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb"] Jun 11 19:30:58.453119 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.453090 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.453228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.453130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.453228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.453152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxl9z\" (UniqueName: \"kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.554023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.553989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.554023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.554027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxl9z\" (UniqueName: \"kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.554221 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.554087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.554375 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.554354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.554434 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.554414 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.569547 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.569528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxl9z\" (UniqueName: \"kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.701351 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.701315 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:30:58.840494 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:58.840444 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb"] Jun 11 19:30:58.841838 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:30:58.841806 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c38dbaa_1408_44b1_b0ad_80d259a9eb98.slice/crio-03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7 WatchSource:0}: Error finding container 03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7: Status 404 returned error can't find the container with id 03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7 Jun 11 19:30:59.420891 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:59.420860 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerID="5b2185b591352fb7b28f58da70eaa31f98c08fb2401e554e92562f60526a6542" exitCode=0 Jun 11 19:30:59.421070 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:59.420934 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" event={"ID":"2c38dbaa-1408-44b1-b0ad-80d259a9eb98","Type":"ContainerDied","Data":"5b2185b591352fb7b28f58da70eaa31f98c08fb2401e554e92562f60526a6542"} Jun 11 19:30:59.421070 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:30:59.420971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" event={"ID":"2c38dbaa-1408-44b1-b0ad-80d259a9eb98","Type":"ContainerStarted","Data":"03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7"} Jun 11 19:31:01.196897 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:01.196863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:01.612152 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:01.612073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:01.842269 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:01.842229 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:01.943975 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:01.943913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:02.098891 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.098850 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:02.170611 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.170580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:02.435585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.435559 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerID="07a00e1ec2472702130e88a297c4e28a11c4dcad226089f6141e4f8f42a5f611" exitCode=0 Jun 11 19:31:02.435921 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.435633 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" event={"ID":"2c38dbaa-1408-44b1-b0ad-80d259a9eb98","Type":"ContainerDied","Data":"07a00e1ec2472702130e88a297c4e28a11c4dcad226089f6141e4f8f42a5f611"} Jun 11 19:31:02.578914 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.578879 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb"] Jun 11 19:31:02.581159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.581140 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.583845 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.583828 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-954rt\"" Jun 11 19:31:02.584105 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.584089 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 19:31:02.584152 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.584107 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 19:31:02.596725 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.596703 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb"] Jun 11 19:31:02.687930 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.687903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.688050 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.687962 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvsj\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-kube-api-access-ctvsj\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.788327 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.788254 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvsj\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-kube-api-access-ctvsj\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.788327 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.788299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.796989 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.796965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.797101 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.797084 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvsj\" (UniqueName: \"kubernetes.io/projected/bbf8cd93-ff79-428b-8c74-18da00992b2e-kube-api-access-ctvsj\") pod \"cert-manager-webhook-7dc76cbb94-7kkwb\" (UID: \"bbf8cd93-ff79-428b-8c74-18da00992b2e\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:02.944447 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:02.944418 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:03.079598 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:03.079574 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb"] Jun 11 19:31:03.081473 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:03.081438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbf8cd93_ff79_428b_8c74_18da00992b2e.slice/crio-a07d1f286d21fb56c312fa07ea5ff06db15c56d7da5f0db2a2dfea0a048c48cb WatchSource:0}: Error finding container a07d1f286d21fb56c312fa07ea5ff06db15c56d7da5f0db2a2dfea0a048c48cb: Status 404 returned error can't find the container with id a07d1f286d21fb56c312fa07ea5ff06db15c56d7da5f0db2a2dfea0a048c48cb Jun 11 19:31:03.440999 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:03.440961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" event={"ID":"bbf8cd93-ff79-428b-8c74-18da00992b2e","Type":"ContainerStarted","Data":"a07d1f286d21fb56c312fa07ea5ff06db15c56d7da5f0db2a2dfea0a048c48cb"} Jun 11 19:31:03.442985 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:03.442963 2562 generic.go:356] "Generic (PLEG): container finished" podID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerID="9b1fc85e5b20dc8cfb9ee10635243b9989b462462a038b82ea9800531aec5769" exitCode=0 Jun 11 19:31:03.443093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:03.443017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" event={"ID":"2c38dbaa-1408-44b1-b0ad-80d259a9eb98","Type":"ContainerDied","Data":"9b1fc85e5b20dc8cfb9ee10635243b9989b462462a038b82ea9800531aec5769"} Jun 11 19:31:04.593933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.593908 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:31:04.703837 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.703754 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kxl9z\" (UniqueName: \"kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z\") pod \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " Jun 11 19:31:04.703837 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.703794 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle\") pod \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " Jun 11 19:31:04.703837 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.703823 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util\") pod \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\" (UID: \"2c38dbaa-1408-44b1-b0ad-80d259a9eb98\") " Jun 11 19:31:04.704355 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.704293 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle" (OuterVolumeSpecName: "bundle") pod "2c38dbaa-1408-44b1-b0ad-80d259a9eb98" (UID: "2c38dbaa-1408-44b1-b0ad-80d259a9eb98"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:31:04.706249 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.706205 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z" (OuterVolumeSpecName: "kube-api-access-kxl9z") pod "2c38dbaa-1408-44b1-b0ad-80d259a9eb98" (UID: "2c38dbaa-1408-44b1-b0ad-80d259a9eb98"). InnerVolumeSpecName "kube-api-access-kxl9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:04.709989 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.709961 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util" (OuterVolumeSpecName: "util") pod "2c38dbaa-1408-44b1-b0ad-80d259a9eb98" (UID: "2c38dbaa-1408-44b1-b0ad-80d259a9eb98"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:31:04.805286 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.805257 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kxl9z\" (UniqueName: \"kubernetes.io/projected/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-kube-api-access-kxl9z\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:04.805286 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.805283 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:04.805286 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:04.805292 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2c38dbaa-1408-44b1-b0ad-80d259a9eb98-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:05.454913 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:05.454878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" event={"ID":"2c38dbaa-1408-44b1-b0ad-80d259a9eb98","Type":"ContainerDied","Data":"03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7"} Jun 11 19:31:05.455081 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:05.454920 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fcckbb" Jun 11 19:31:05.455081 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:05.454936 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03053ad365b96da31a4a5006aaae1cede9521ead11aaa63e43620c9079549ed7" Jun 11 19:31:06.460127 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:06.460094 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" event={"ID":"bbf8cd93-ff79-428b-8c74-18da00992b2e","Type":"ContainerStarted","Data":"b523ad27ac2d6f2e6fec06a425cc1c0ae790e7cd7814862333a6d09ec3d1ac52"} Jun 11 19:31:06.460493 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:06.460161 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:06.492571 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:06.492492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" podStartSLOduration=1.3418081499999999 podStartE2EDuration="4.492456322s" totalImagesPullingTime="3.150648172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:06.490794801 +0000 UTC m=+497.206902765" watchObservedRunningTime="2026-06-11 19:31:06.492456322 +0000 UTC m=+497.208564288" Jun 11 19:31:06.526262 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:06.526241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:06.625183 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:06.625150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:08.788423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:08.788384 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:09.390965 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:09.390925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:09.490652 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:09.490589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:12.465578 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:12.465554 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7kkwb" Jun 11 19:31:15.328511 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:15.328480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:15.432303 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:15.432230 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234203 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh"] Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234832 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="util" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234849 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="util" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234882 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="pull" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234891 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="pull" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234905 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="extract" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.234914 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="extract" Jun 11 19:31:17.235777 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.235045 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c38dbaa-1408-44b1-b0ad-80d259a9eb98" containerName="extract" Jun 11 19:31:17.240759 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.240738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.244157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.244133 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:31:17.244157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.244135 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:31:17.244304 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.244135 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:31:17.247987 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.247797 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh"] Jun 11 19:31:17.299932 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.299902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.300117 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.299984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.300117 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.300041 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2qp4\" (UniqueName: \"kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.347521 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.347490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:17.400480 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.400437 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.400603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.400497 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.400603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.400541 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2qp4\" (UniqueName: \"kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.400815 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.400796 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.400895 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.400874 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.410167 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.410142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2qp4\" (UniqueName: \"kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.550908 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.550829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:17.678446 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:17.678421 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh"] Jun 11 19:31:17.680499 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:17.680474 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod136f970e_ad7e_4444_bb90_1b55a9682780.slice/crio-7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4 WatchSource:0}: Error finding container 7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4: Status 404 returned error can't find the container with id 7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4 Jun 11 19:31:18.504776 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:18.504744 2562 generic.go:356] "Generic (PLEG): container finished" podID="136f970e-ad7e-4444-bb90-1b55a9682780" containerID="74340b2236890eae15c5ce12ee460c89c4d5131fca825dff4d303dd3edbe6156" exitCode=0 Jun 11 19:31:18.505111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:18.504823 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" event={"ID":"136f970e-ad7e-4444-bb90-1b55a9682780","Type":"ContainerDied","Data":"74340b2236890eae15c5ce12ee460c89c4d5131fca825dff4d303dd3edbe6156"} Jun 11 19:31:18.505111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:18.504878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" event={"ID":"136f970e-ad7e-4444-bb90-1b55a9682780","Type":"ContainerStarted","Data":"7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4"} Jun 11 19:31:19.510212 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:19.510171 2562 generic.go:356] "Generic (PLEG): container finished" podID="136f970e-ad7e-4444-bb90-1b55a9682780" containerID="0138118443d32660b8f323a57b1c81c4f068fae4d28207f91cca6eb83e3d7f41" exitCode=0 Jun 11 19:31:19.510737 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:19.510230 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" event={"ID":"136f970e-ad7e-4444-bb90-1b55a9682780","Type":"ContainerDied","Data":"0138118443d32660b8f323a57b1c81c4f068fae4d28207f91cca6eb83e3d7f41"} Jun 11 19:31:20.516885 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:20.516850 2562 generic.go:356] "Generic (PLEG): container finished" podID="136f970e-ad7e-4444-bb90-1b55a9682780" containerID="028893bb8379f6c86ac087b62ce0126dc042ec541631b802dc78fc7683ebd99c" exitCode=0 Jun 11 19:31:20.517273 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:20.516936 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" event={"ID":"136f970e-ad7e-4444-bb90-1b55a9682780","Type":"ContainerDied","Data":"028893bb8379f6c86ac087b62ce0126dc042ec541631b802dc78fc7683ebd99c"} Jun 11 19:31:21.640957 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.640934 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:21.734178 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.734149 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle\") pod \"136f970e-ad7e-4444-bb90-1b55a9682780\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " Jun 11 19:31:21.734339 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.734208 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util\") pod \"136f970e-ad7e-4444-bb90-1b55a9682780\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " Jun 11 19:31:21.734339 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.734293 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2qp4\" (UniqueName: \"kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4\") pod \"136f970e-ad7e-4444-bb90-1b55a9682780\" (UID: \"136f970e-ad7e-4444-bb90-1b55a9682780\") " Jun 11 19:31:21.734891 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.734862 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle" (OuterVolumeSpecName: "bundle") pod "136f970e-ad7e-4444-bb90-1b55a9682780" (UID: "136f970e-ad7e-4444-bb90-1b55a9682780"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:31:21.736445 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.736418 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4" (OuterVolumeSpecName: "kube-api-access-j2qp4") pod "136f970e-ad7e-4444-bb90-1b55a9682780" (UID: "136f970e-ad7e-4444-bb90-1b55a9682780"). InnerVolumeSpecName "kube-api-access-j2qp4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:31:21.742579 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.742550 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util" (OuterVolumeSpecName: "util") pod "136f970e-ad7e-4444-bb90-1b55a9682780" (UID: "136f970e-ad7e-4444-bb90-1b55a9682780"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:31:21.834831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.834753 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2qp4\" (UniqueName: \"kubernetes.io/projected/136f970e-ad7e-4444-bb90-1b55a9682780-kube-api-access-j2qp4\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:21.834831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.834780 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:21.834831 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:21.834789 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/136f970e-ad7e-4444-bb90-1b55a9682780-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:31:22.527399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:22.527364 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" event={"ID":"136f970e-ad7e-4444-bb90-1b55a9682780","Type":"ContainerDied","Data":"7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4"} Jun 11 19:31:22.527590 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:22.527423 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cbe92aeb4aec36322da5f0923d356b31cf9703b9305322b7720ae9c3c1e38a4" Jun 11 19:31:22.527590 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:22.527376 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cdsdrdh" Jun 11 19:31:32.936660 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:32.936570 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.054052 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.054010 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.570018 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.569971 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.861820 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.861731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.959427 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.959394 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:33.996285 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996255 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94"] Jun 11 19:31:33.996553 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996540 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="extract" Jun 11 19:31:33.996595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996554 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="extract" Jun 11 19:31:33.996595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996569 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="util" Jun 11 19:31:33.996595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996575 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="util" Jun 11 19:31:33.996595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996582 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="pull" Jun 11 19:31:33.996595 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996587 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="pull" Jun 11 19:31:33.996750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.996632 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="136f970e-ad7e-4444-bb90-1b55a9682780" containerName="extract" Jun 11 19:31:33.998854 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:33.998840 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.001750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.001729 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kmkd4\"" Jun 11 19:31:34.001884 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.001771 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 19:31:34.001884 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.001776 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 19:31:34.001884 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.001778 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 19:31:34.002057 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.002040 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 19:31:34.019222 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.019204 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94"] Jun 11 19:31:34.132739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.132665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.132739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.132700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.132739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.132738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.132966 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.132821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.132966 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.132885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ktsc\" (UniqueName: \"kubernetes.io/projected/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-kube-api-access-4ktsc\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.166913 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.166880 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.233949 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.233925 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.234033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.233967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ktsc\" (UniqueName: \"kubernetes.io/projected/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-kube-api-access-4ktsc\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.234033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.233995 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.234033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.234013 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.234172 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.234034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.234366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.234342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-manifests\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.236338 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.236314 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-tmp\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.236488 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.236446 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-webhook-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.236618 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.236601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.245029 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.245006 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ktsc\" (UniqueName: \"kubernetes.io/projected/15e7ed90-cbf9-4e6c-b710-130864ebfa7b-kube-api-access-4ktsc\") pod \"opendatahub-operator-controller-manager-69cb86dcf5-c7b94\" (UID: \"15e7ed90-cbf9-4e6c-b710-130864ebfa7b\") " pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.265236 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.265212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.309193 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.309170 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:34.366005 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.365975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.446799 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.446775 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94"] Jun 11 19:31:34.448478 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:34.448436 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e7ed90_cbf9_4e6c_b710_130864ebfa7b.slice/crio-987cc143f2f3b3e86e7daf512a44e820b88dc2e6698daa37ff69ef2d9f27572a WatchSource:0}: Error finding container 987cc143f2f3b3e86e7daf512a44e820b88dc2e6698daa37ff69ef2d9f27572a: Status 404 returned error can't find the container with id 987cc143f2f3b3e86e7daf512a44e820b88dc2e6698daa37ff69ef2d9f27572a Jun 11 19:31:34.449264 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.449228 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.578526 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.578493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" event={"ID":"15e7ed90-cbf9-4e6c-b710-130864ebfa7b","Type":"ContainerStarted","Data":"987cc143f2f3b3e86e7daf512a44e820b88dc2e6698daa37ff69ef2d9f27572a"} Jun 11 19:31:34.607188 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.607157 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:34.723151 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:34.723115 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:37.594477 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:37.594426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" event={"ID":"15e7ed90-cbf9-4e6c-b710-130864ebfa7b","Type":"ContainerStarted","Data":"2c48a8ad847a024b9f5d8f404cd4001f37895cdac1d4845ddd847c382876f736"} Jun 11 19:31:38.600324 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:38.600289 2562 generic.go:356] "Generic (PLEG): container finished" podID="15e7ed90-cbf9-4e6c-b710-130864ebfa7b" containerID="2c48a8ad847a024b9f5d8f404cd4001f37895cdac1d4845ddd847c382876f736" exitCode=0 Jun 11 19:31:38.600712 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:38.600370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" event={"ID":"15e7ed90-cbf9-4e6c-b710-130864ebfa7b","Type":"ContainerDied","Data":"2c48a8ad847a024b9f5d8f404cd4001f37895cdac1d4845ddd847c382876f736"} Jun 11 19:31:39.606229 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:39.606191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" event={"ID":"15e7ed90-cbf9-4e6c-b710-130864ebfa7b","Type":"ContainerStarted","Data":"14164ede9afca1b60b0f0ea457594b73f823ce0bacea39620155135626526175"} Jun 11 19:31:39.606714 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:39.606314 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:39.632121 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:39.632075 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" podStartSLOduration=2.318499429 podStartE2EDuration="6.632060624s" totalImagesPullingTime="3.368667655s" totalInitContainerRuntime="944.89354ms" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:39.630837521 +0000 UTC m=+530.346945485" watchObservedRunningTime="2026-06-11 19:31:39.632060624 +0000 UTC m=+530.348168588" Jun 11 19:31:50.612351 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:50.612318 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-69cb86dcf5-c7b94" Jun 11 19:31:52.840931 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:52.840897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.017506 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.017447 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.667679 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.667644 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-k2sqb"] Jun 11 19:31:53.676064 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.676036 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.686002 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.685980 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qlgrd\"" Jun 11 19:31:53.686190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.686173 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 19:31:53.689169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.689141 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plvfq\" (UniqueName: \"kubernetes.io/projected/abedb934-2e20-47b7-ab82-1cdade0b3930-kube-api-access-plvfq\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.689287 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.689225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.690834 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.690812 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-k2sqb"] Jun 11 19:31:53.738858 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.738833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.790476 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.790436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.790629 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:31:53.790611 2562 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 19:31:53.790700 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.790627 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plvfq\" (UniqueName: \"kubernetes.io/projected/abedb934-2e20-47b7-ab82-1cdade0b3930-kube-api-access-plvfq\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.790700 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:31:53.790666 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert podName:abedb934-2e20-47b7-ab82-1cdade0b3930 nodeName:}" failed. No retries permitted until 2026-06-11 19:31:54.290649206 +0000 UTC m=+545.006757149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert") pod "odh-model-controller-6dc94f689f-k2sqb" (UID: "abedb934-2e20-47b7-ab82-1cdade0b3930") : secret "odh-model-controller-webhook-cert" not found Jun 11 19:31:53.816778 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.816750 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plvfq\" (UniqueName: \"kubernetes.io/projected/abedb934-2e20-47b7-ab82-1cdade0b3930-kube-api-access-plvfq\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:53.841008 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.840970 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:53.958905 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:53.958876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:54.094983 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.094953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:54.294022 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.293951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:54.296478 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.296438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abedb934-2e20-47b7-ab82-1cdade0b3930-cert\") pod \"odh-model-controller-6dc94f689f-k2sqb\" (UID: \"abedb934-2e20-47b7-ab82-1cdade0b3930\") " pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:54.472598 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.472563 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cv45j"] Jun 11 19:31:54.476003 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.475989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.479009 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.478991 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 19:31:54.489267 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.489245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:54.495510 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.495489 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7htrn\" (UniqueName: \"kubernetes.io/projected/3a75dc8b-8df2-4c64-a285-bed6751b1a16-kube-api-access-7htrn\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.495633 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.495524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a75dc8b-8df2-4c64-a285-bed6751b1a16-tls-certs\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.497255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.497236 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cv45j"] Jun 11 19:31:54.585585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.585487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:54.595910 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.595878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7htrn\" (UniqueName: \"kubernetes.io/projected/3a75dc8b-8df2-4c64-a285-bed6751b1a16-kube-api-access-7htrn\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.596053 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.595937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a75dc8b-8df2-4c64-a285-bed6751b1a16-tls-certs\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.598541 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.598507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a75dc8b-8df2-4c64-a285-bed6751b1a16-tls-certs\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.609188 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.609161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7htrn\" (UniqueName: \"kubernetes.io/projected/3a75dc8b-8df2-4c64-a285-bed6751b1a16-kube-api-access-7htrn\") pod \"model-serving-api-5dd488fc48-cv45j\" (UID: \"3a75dc8b-8df2-4c64-a285-bed6751b1a16\") " pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.615880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.615845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:54.737155 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.737130 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-k2sqb"] Jun 11 19:31:54.739574 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:54.739548 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabedb934_2e20_47b7_ab82_1cdade0b3930.slice/crio-1a8d4d638c46847c801bbd45473a61749fa9023f6bfe5a433184b83ad60cad36 WatchSource:0}: Error finding container 1a8d4d638c46847c801bbd45473a61749fa9023f6bfe5a433184b83ad60cad36: Status 404 returned error can't find the container with id 1a8d4d638c46847c801bbd45473a61749fa9023f6bfe5a433184b83ad60cad36 Jun 11 19:31:54.786613 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.786584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:54.924526 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:54.924505 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-cv45j"] Jun 11 19:31:55.680236 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:55.680185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" event={"ID":"3a75dc8b-8df2-4c64-a285-bed6751b1a16","Type":"ContainerStarted","Data":"b131b6c4687975a9b5665447741194adeb29022b13329b372890becbe975d473"} Jun 11 19:31:55.682285 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:55.682227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" event={"ID":"abedb934-2e20-47b7-ab82-1cdade0b3930","Type":"ContainerStarted","Data":"1a8d4d638c46847c801bbd45473a61749fa9023f6bfe5a433184b83ad60cad36"} Jun 11 19:31:56.077896 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.077749 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:56.159534 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.158592 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5"] Jun 11 19:31:56.183938 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.183909 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.189258 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.189222 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5"] Jun 11 19:31:56.190765 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.190745 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 19:31:56.191133 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.191115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 19:31:56.194697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.193003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-bzdbl\"" Jun 11 19:31:56.194697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.193011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 19:31:56.194697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.193447 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 19:31:56.194697 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.193742 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 19:31:56.202527 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.201967 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:56.210150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.209655 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.210150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.209726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-manager-config\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.210150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.209879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.210150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.210016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnp9v\" (UniqueName: \"kubernetes.io/projected/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-kube-api-access-gnp9v\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.311239 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.311190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnp9v\" (UniqueName: \"kubernetes.io/projected/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-kube-api-access-gnp9v\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.311428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.311278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.311428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.311315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-manager-config\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.311428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.311365 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.312235 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.312189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-manager-config\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.314494 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.314447 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-metrics-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.314647 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.314629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-cert\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.325913 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.325882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnp9v\" (UniqueName: \"kubernetes.io/projected/fe20a9dd-d5f5-4159-abc1-b15f0739cc1c-kube-api-access-gnp9v\") pod \"lws-controller-manager-7b7c45796d-q4cn5\" (UID: \"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c\") " pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.504862 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.504821 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:31:56.510082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.509998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:56.598105 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.598060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:56.634743 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.634707 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw"] Jun 11 19:31:56.641652 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.641626 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.644396 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.644375 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:31:56.644577 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.644449 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:31:56.644577 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.644553 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:31:56.648255 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.648215 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw"] Jun 11 19:31:56.714749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.714716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.714933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.714771 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfqz9\" (UniqueName: \"kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.714933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.714809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.815850 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.815771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfqz9\" (UniqueName: \"kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.815850 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.815828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.816073 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.815921 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.816277 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.816258 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.816343 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.816303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.825960 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.825936 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfqz9\" (UniqueName: \"kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:56.843366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.843326 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:31:56.954588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:56.954558 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:31:58.819225 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:58.819193 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5"] Jun 11 19:31:58.824596 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:58.824476 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe20a9dd_d5f5_4159_abc1_b15f0739cc1c.slice/crio-603b507209306dcb70140f068fbcc51ffa8d8bad54177f75532b451d1806c103 WatchSource:0}: Error finding container 603b507209306dcb70140f068fbcc51ffa8d8bad54177f75532b451d1806c103: Status 404 returned error can't find the container with id 603b507209306dcb70140f068fbcc51ffa8d8bad54177f75532b451d1806c103 Jun 11 19:31:58.845325 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:58.845285 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw"] Jun 11 19:31:58.846414 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:31:58.846383 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1592db2e_3344_47d9_b6a0_de06d84ea806.slice/crio-1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9 WatchSource:0}: Error finding container 1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9: Status 404 returned error can't find the container with id 1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9 Jun 11 19:31:59.705627 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.705597 2562 generic.go:356] "Generic (PLEG): container finished" podID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerID="63e0a5e8b645d701610d7259ec8916abef04ffc48cd19fd380224ad420afcba3" exitCode=0 Jun 11 19:31:59.705796 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.705686 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" event={"ID":"1592db2e-3344-47d9-b6a0-de06d84ea806","Type":"ContainerDied","Data":"63e0a5e8b645d701610d7259ec8916abef04ffc48cd19fd380224ad420afcba3"} Jun 11 19:31:59.705796 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.705752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" event={"ID":"1592db2e-3344-47d9-b6a0-de06d84ea806","Type":"ContainerStarted","Data":"1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9"} Jun 11 19:31:59.707337 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.707307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" event={"ID":"3a75dc8b-8df2-4c64-a285-bed6751b1a16","Type":"ContainerStarted","Data":"c3102ef10fd0c3e875f1279318c7cdf0f01ba5d8b8b48002d8182cc90eb99ffd"} Jun 11 19:31:59.707479 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.707365 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:31:59.708557 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.708450 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" event={"ID":"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c","Type":"ContainerStarted","Data":"603b507209306dcb70140f068fbcc51ffa8d8bad54177f75532b451d1806c103"} Jun 11 19:31:59.709909 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.709889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" event={"ID":"abedb934-2e20-47b7-ab82-1cdade0b3930","Type":"ContainerStarted","Data":"2248ab3b27d64546cfd186222a341ec96419912b0f4de649524dd1ddaa397764"} Jun 11 19:31:59.710039 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.710027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:31:59.770322 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.770268 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" podStartSLOduration=2.807817602 podStartE2EDuration="6.770249934s" totalImagesPullingTime="3.962432332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:59.767847589 +0000 UTC m=+550.483955574" watchObservedRunningTime="2026-06-11 19:31:59.770249934 +0000 UTC m=+550.486357900" Jun 11 19:31:59.799928 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:31:59.799885 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" podStartSLOduration=2.071810726 podStartE2EDuration="5.799869201s" totalImagesPullingTime="3.728058475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:31:59.7991245 +0000 UTC m=+550.515232479" watchObservedRunningTime="2026-06-11 19:31:59.799869201 +0000 UTC m=+550.515977166" Jun 11 19:32:01.726865 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:01.726832 2562 generic.go:356] "Generic (PLEG): container finished" podID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerID="f407e106e7b167d3ddb4139ea772194a17cedcd6e3068f715c9027ecd0c4c207" exitCode=0 Jun 11 19:32:01.727304 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:01.726918 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" event={"ID":"1592db2e-3344-47d9-b6a0-de06d84ea806","Type":"ContainerDied","Data":"f407e106e7b167d3ddb4139ea772194a17cedcd6e3068f715c9027ecd0c4c207"} Jun 11 19:32:01.728765 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:01.728732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" event={"ID":"fe20a9dd-d5f5-4159-abc1-b15f0739cc1c","Type":"ContainerStarted","Data":"dc574c449fa7835ac587d6ddbc28d0b8be368db6635d473ca3caaf220db86731"} Jun 11 19:32:01.728882 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:01.728867 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:32:01.806225 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:01.806177 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" podStartSLOduration=3.928046555 podStartE2EDuration="5.806160375s" totalImagesPullingTime="1.87811382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:31:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:01.804772606 +0000 UTC m=+552.520880578" watchObservedRunningTime="2026-06-11 19:32:01.806160375 +0000 UTC m=+552.522268337" Jun 11 19:32:02.735781 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:02.735693 2562 generic.go:356] "Generic (PLEG): container finished" podID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerID="26f19c15df3bfa91e21154921cefd473fd54ff4c7eff3d145a09d33bce873e85" exitCode=0 Jun 11 19:32:02.736206 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:02.735773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" event={"ID":"1592db2e-3344-47d9-b6a0-de06d84ea806","Type":"ContainerDied","Data":"26f19c15df3bfa91e21154921cefd473fd54ff4c7eff3d145a09d33bce873e85"} Jun 11 19:32:03.864066 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.864034 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:32:03.876517 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.876497 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle\") pod \"1592db2e-3344-47d9-b6a0-de06d84ea806\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " Jun 11 19:32:03.876599 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.876544 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util\") pod \"1592db2e-3344-47d9-b6a0-de06d84ea806\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " Jun 11 19:32:03.876599 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.876592 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfqz9\" (UniqueName: \"kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9\") pod \"1592db2e-3344-47d9-b6a0-de06d84ea806\" (UID: \"1592db2e-3344-47d9-b6a0-de06d84ea806\") " Jun 11 19:32:03.877389 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.877363 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle" (OuterVolumeSpecName: "bundle") pod "1592db2e-3344-47d9-b6a0-de06d84ea806" (UID: "1592db2e-3344-47d9-b6a0-de06d84ea806"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:32:03.878793 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.878772 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9" (OuterVolumeSpecName: "kube-api-access-rfqz9") pod "1592db2e-3344-47d9-b6a0-de06d84ea806" (UID: "1592db2e-3344-47d9-b6a0-de06d84ea806"). InnerVolumeSpecName "kube-api-access-rfqz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:32:03.881477 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.881440 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util" (OuterVolumeSpecName: "util") pod "1592db2e-3344-47d9-b6a0-de06d84ea806" (UID: "1592db2e-3344-47d9-b6a0-de06d84ea806"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:32:03.977989 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.977965 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:03.977989 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.977989 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfqz9\" (UniqueName: \"kubernetes.io/projected/1592db2e-3344-47d9-b6a0-de06d84ea806-kube-api-access-rfqz9\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:03.978145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:03.977998 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1592db2e-3344-47d9-b6a0-de06d84ea806-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:04.472791 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.472753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:04.602230 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.602191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:04.745889 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.745814 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" Jun 11 19:32:04.745889 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.745853 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06mhxcw" event={"ID":"1592db2e-3344-47d9-b6a0-de06d84ea806","Type":"ContainerDied","Data":"1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9"} Jun 11 19:32:04.746097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.745891 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c1da58aa17e7857e05230f8ef3f7bc1c6bc5f254f2cd242e1b7ba73f8dbe2c9" Jun 11 19:32:04.977243 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:04.977209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:05.107428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:05.107347 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:05.738674 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:05.738633 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:05.839956 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:05.839928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:09.424153 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:09.424121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:09.544983 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:09.544939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:10.619374 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619345 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x"] Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619665 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="extract" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619677 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="extract" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619689 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="util" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619695 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="util" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619714 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="pull" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619719 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="pull" Jun 11 19:32:10.619772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.619765 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1592db2e-3344-47d9-b6a0-de06d84ea806" containerName="extract" Jun 11 19:32:10.626314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.626293 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.640208 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.640186 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:32:10.640319 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.640230 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:32:10.641307 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.641290 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:32:10.682007 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.681975 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x"] Jun 11 19:32:10.718099 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.718070 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-k2sqb" Jun 11 19:32:10.721030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.721011 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-cv45j" Jun 11 19:32:10.748625 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.748592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.748829 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.748661 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.748829 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.748756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdlnn\" (UniqueName: \"kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.849488 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.849432 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.849684 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.849535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdlnn\" (UniqueName: \"kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.849684 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.849629 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.849979 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.849949 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.850038 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.850013 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.896200 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.896120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdlnn\" (UniqueName: \"kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:10.935224 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:10.935197 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:11.146625 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:32:11.146550 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63bfe667_0414_4725_b44b_d507b9355028.slice/crio-648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04 WatchSource:0}: Error finding container 648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04: Status 404 returned error can't find the container with id 648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04 Jun 11 19:32:11.155347 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.155320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x"] Jun 11 19:32:11.211009 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.210966 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:11.385885 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.385854 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:11.576648 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.576611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:11.780765 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.780734 2562 generic.go:356] "Generic (PLEG): container finished" podID="63bfe667-0414-4725-b44b-d507b9355028" containerID="989056f9951e7259fa0b382d85f0e0fdb322734ff80b022d30a2aeac8e7b6243" exitCode=0 Jun 11 19:32:11.781170 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.780826 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" event={"ID":"63bfe667-0414-4725-b44b-d507b9355028","Type":"ContainerDied","Data":"989056f9951e7259fa0b382d85f0e0fdb322734ff80b022d30a2aeac8e7b6243"} Jun 11 19:32:11.781170 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.780884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" event={"ID":"63bfe667-0414-4725-b44b-d507b9355028","Type":"ContainerStarted","Data":"648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04"} Jun 11 19:32:11.951631 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:11.951602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:12.738616 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:12.738588 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7b7c45796d-q4cn5" Jun 11 19:32:12.789450 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:12.789366 2562 generic.go:356] "Generic (PLEG): container finished" podID="63bfe667-0414-4725-b44b-d507b9355028" containerID="f2ecefeb81acbfb80f331ce7e20bc6ef07a54eeeb6b6d401019455f4fb941980" exitCode=0 Jun 11 19:32:12.789870 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:12.789443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" event={"ID":"63bfe667-0414-4725-b44b-d507b9355028","Type":"ContainerDied","Data":"f2ecefeb81acbfb80f331ce7e20bc6ef07a54eeeb6b6d401019455f4fb941980"} Jun 11 19:32:13.574941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.574913 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-5d9fb4b449-js7n7"] Jun 11 19:32:13.578332 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.578316 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.582228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.582202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jpp92\"" Jun 11 19:32:13.582740 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.582725 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 19:32:13.600413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.600392 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d9fb4b449-js7n7"] Jun 11 19:32:13.624143 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.624105 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:13.672369 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.672340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecc60ecf-c492-40e0-94e9-26e5dd410e29-redirect-config\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.672544 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.672403 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg8qc\" (UniqueName: \"kubernetes.io/projected/ecc60ecf-c492-40e0-94e9-26e5dd410e29-kube-api-access-fg8qc\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.773075 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.773038 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecc60ecf-c492-40e0-94e9-26e5dd410e29-redirect-config\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.773245 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.773115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg8qc\" (UniqueName: \"kubernetes.io/projected/ecc60ecf-c492-40e0-94e9-26e5dd410e29-kube-api-access-fg8qc\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.773758 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.773735 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/ecc60ecf-c492-40e0-94e9-26e5dd410e29-redirect-config\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.783314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.783291 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg8qc\" (UniqueName: \"kubernetes.io/projected/ecc60ecf-c492-40e0-94e9-26e5dd410e29-kube-api-access-fg8qc\") pod \"dashboard-redirect-5d9fb4b449-js7n7\" (UID: \"ecc60ecf-c492-40e0-94e9-26e5dd410e29\") " pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:13.796097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.796067 2562 generic.go:356] "Generic (PLEG): container finished" podID="63bfe667-0414-4725-b44b-d507b9355028" containerID="be3d24093c4e72562a3458a8c14a8708b012a20877115fb43cc83c4612edfe3e" exitCode=0 Jun 11 19:32:13.796390 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.796153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" event={"ID":"63bfe667-0414-4725-b44b-d507b9355028","Type":"ContainerDied","Data":"be3d24093c4e72562a3458a8c14a8708b012a20877115fb43cc83c4612edfe3e"} Jun 11 19:32:13.888768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:13.888683 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" Jun 11 19:32:14.042319 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.042295 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-5d9fb4b449-js7n7"] Jun 11 19:32:14.044625 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:32:14.044597 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc60ecf_c492_40e0_94e9_26e5dd410e29.slice/crio-9f3cf90cf7b97c9ddf05ec93cb4a1856c7253d59ec4804b64461b4170e1dc770 WatchSource:0}: Error finding container 9f3cf90cf7b97c9ddf05ec93cb4a1856c7253d59ec4804b64461b4170e1dc770: Status 404 returned error can't find the container with id 9f3cf90cf7b97c9ddf05ec93cb4a1856c7253d59ec4804b64461b4170e1dc770 Jun 11 19:32:14.802824 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.802790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" event={"ID":"ecc60ecf-c492-40e0-94e9-26e5dd410e29","Type":"ContainerStarted","Data":"9f3cf90cf7b97c9ddf05ec93cb4a1856c7253d59ec4804b64461b4170e1dc770"} Jun 11 19:32:14.930399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.930373 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:14.982307 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.982273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle\") pod \"63bfe667-0414-4725-b44b-d507b9355028\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " Jun 11 19:32:14.982307 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.982303 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdlnn\" (UniqueName: \"kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn\") pod \"63bfe667-0414-4725-b44b-d507b9355028\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " Jun 11 19:32:14.982558 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.982331 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util\") pod \"63bfe667-0414-4725-b44b-d507b9355028\" (UID: \"63bfe667-0414-4725-b44b-d507b9355028\") " Jun 11 19:32:14.983300 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.983274 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle" (OuterVolumeSpecName: "bundle") pod "63bfe667-0414-4725-b44b-d507b9355028" (UID: "63bfe667-0414-4725-b44b-d507b9355028"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:32:14.984581 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.984552 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn" (OuterVolumeSpecName: "kube-api-access-jdlnn") pod "63bfe667-0414-4725-b44b-d507b9355028" (UID: "63bfe667-0414-4725-b44b-d507b9355028"). InnerVolumeSpecName "kube-api-access-jdlnn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:32:14.988161 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:14.988121 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util" (OuterVolumeSpecName: "util") pod "63bfe667-0414-4725-b44b-d507b9355028" (UID: "63bfe667-0414-4725-b44b-d507b9355028"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:32:15.083641 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.083545 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:15.083641 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.083580 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdlnn\" (UniqueName: \"kubernetes.io/projected/63bfe667-0414-4725-b44b-d507b9355028-kube-api-access-jdlnn\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:15.083641 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.083595 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63bfe667-0414-4725-b44b-d507b9355028-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:15.810024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.809992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" event={"ID":"63bfe667-0414-4725-b44b-d507b9355028","Type":"ContainerDied","Data":"648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04"} Jun 11 19:32:15.810417 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.810036 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762aqb59x" Jun 11 19:32:15.810417 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:15.810046 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="648ea9e907fa728bd472f834d69dfde237fdf7c399a6b0c8e24ab212922e7f04" Jun 11 19:32:16.816230 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:16.816197 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" event={"ID":"ecc60ecf-c492-40e0-94e9-26e5dd410e29","Type":"ContainerStarted","Data":"9b076d92d37fd0fc380d04d1c89c6f1b282abbb68d61d3056ef8350431b15cf8"} Jun 11 19:32:16.835904 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:16.835855 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-5d9fb4b449-js7n7" podStartSLOduration=1.671064012 podStartE2EDuration="3.835840873s" totalImagesPullingTime="2.164776861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:16.834388437 +0000 UTC m=+567.550496412" watchObservedRunningTime="2026-06-11 19:32:16.835840873 +0000 UTC m=+567.551948837" Jun 11 19:32:21.534631 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:21.534585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:21.625764 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:21.625737 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:27.309218 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:27.309184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:27.424645 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:27.424607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:27.833302 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:27.833263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.343624 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.343585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.437030 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.436998 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.597518 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597432 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2"] Jun 11 19:32:31.597894 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597875 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="pull" Jun 11 19:32:31.598006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597895 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="pull" Jun 11 19:32:31.598006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="extract" Jun 11 19:32:31.598006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597916 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="extract" Jun 11 19:32:31.598006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597928 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="util" Jun 11 19:32:31.598006 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.597936 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="util" Jun 11 19:32:31.598243 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.598016 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63bfe667-0414-4725-b44b-d507b9355028" containerName="extract" Jun 11 19:32:31.643044 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.643013 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.678305 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.678279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2"] Jun 11 19:32:31.678426 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.678381 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.682093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.682074 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 19:32:31.682395 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.682361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-qgzcs\"" Jun 11 19:32:31.814513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814512 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814538 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814557 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b5811c-f40f-44ae-988c-50d4a863937d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814677 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b5811c-f40f-44ae-988c-50d4a863937d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814907 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.814907 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.814773 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znx6t\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-kube-api-access-znx6t\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.844111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.844064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.915627 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915627 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znx6t\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-kube-api-access-znx6t\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915627 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915612 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915631 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b5811c-f40f-44ae-988c-50d4a863937d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.915876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.915801 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b5811c-f40f-44ae-988c-50d4a863937d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.916199 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.916015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.916199 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.916055 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.916199 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.916137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.916373 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.916266 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.916486 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.916435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49b5811c-f40f-44ae-988c-50d4a863937d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.917982 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.917954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49b5811c-f40f-44ae-988c-50d4a863937d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.918254 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.918237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49b5811c-f40f-44ae-988c-50d4a863937d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.928147 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.928119 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znx6t\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-kube-api-access-znx6t\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.928889 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.928866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49b5811c-f40f-44ae-988c-50d4a863937d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97959lgm2\" (UID: \"49b5811c-f40f-44ae-988c-50d4a863937d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:31.952157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.952124 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:31.988027 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:31.988005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:32.156116 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:32.156093 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2"] Jun 11 19:32:32.157902 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:32:32.157866 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49b5811c_f40f_44ae_988c_50d4a863937d.slice/crio-2abbb595bf068c54eb0945fa6b3ca1e0bf2185e976266885857a4f1e1a09ff86 WatchSource:0}: Error finding container 2abbb595bf068c54eb0945fa6b3ca1e0bf2185e976266885857a4f1e1a09ff86: Status 404 returned error can't find the container with id 2abbb595bf068c54eb0945fa6b3ca1e0bf2185e976266885857a4f1e1a09ff86 Jun 11 19:32:32.174567 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:32.174534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:32.890020 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:32.889980 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" event={"ID":"49b5811c-f40f-44ae-988c-50d4a863937d","Type":"ContainerStarted","Data":"2abbb595bf068c54eb0945fa6b3ca1e0bf2185e976266885857a4f1e1a09ff86"} Jun 11 19:32:34.866070 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:34.866033 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:32:34.866313 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:34.866105 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:32:34.866313 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:34.866134 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:32:35.905789 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:35.905759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" event={"ID":"49b5811c-f40f-44ae-988c-50d4a863937d","Type":"ContainerStarted","Data":"5ae6b5f8c806f4c1921918e3a4dd79b14a35d9d40f1efcc34eb57c59f9d0f904"} Jun 11 19:32:35.935552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:35.935502 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" podStartSLOduration=2.22950128 podStartE2EDuration="4.9354458s" totalImagesPullingTime="2.70594452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:35.933259097 +0000 UTC m=+586.649367058" watchObservedRunningTime="2026-06-11 19:32:35.9354458 +0000 UTC m=+586.651553827" Jun 11 19:32:35.988703 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:35.988674 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:35.993079 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:35.993060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:36.911313 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:36.911284 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:36.912190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:36.912173 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97959lgm2" Jun 11 19:32:49.703604 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:49.703581 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:32:49.703604 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:49.703591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:32:49.708383 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:49.708367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:32:49.708518 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:49.708367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:32:54.382263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.382226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:54.500522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.500492 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:54.503169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.503146 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:54.505883 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.505847 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 19:32:54.505996 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.505889 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xn29c\"" Jun 11 19:32:54.506847 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.506823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 19:32:54.518218 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.518196 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:54.596977 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.596941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j6df\" (UniqueName: \"kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df\") pod \"kuadrant-operator-catalog-6m9w8\" (UID: \"070c232b-abb2-41e1-9804-671e87f416e4\") " pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:54.697746 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.697717 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j6df\" (UniqueName: \"kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df\") pod \"kuadrant-operator-catalog-6m9w8\" (UID: \"070c232b-abb2-41e1-9804-671e87f416e4\") " pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:54.708719 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.708693 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j6df\" (UniqueName: \"kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df\") pod \"kuadrant-operator-catalog-6m9w8\" (UID: \"070c232b-abb2-41e1-9804-671e87f416e4\") " pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:54.813983 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.813954 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:54.870330 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.870248 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:54.976556 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.976520 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:54.977291 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:32:54.977266 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070c232b_abb2_41e1_9804_671e87f416e4.slice/crio-ce2147c2792dc30372ae6935ba4bf4d7c169c7e52641a4be604c4ccc0b15cbc1 WatchSource:0}: Error finding container ce2147c2792dc30372ae6935ba4bf4d7c169c7e52641a4be604c4ccc0b15cbc1: Status 404 returned error can't find the container with id ce2147c2792dc30372ae6935ba4bf4d7c169c7e52641a4be604c4ccc0b15cbc1 Jun 11 19:32:54.998696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:54.998668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" event={"ID":"070c232b-abb2-41e1-9804-671e87f416e4","Type":"ContainerStarted","Data":"ce2147c2792dc30372ae6935ba4bf4d7c169c7e52641a4be604c4ccc0b15cbc1"} Jun 11 19:32:55.069853 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.069824 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mm6jk"] Jun 11 19:32:55.072655 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.072640 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:32:55.085457 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.085436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mm6jk"] Jun 11 19:32:55.100356 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.100336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjmzz\" (UniqueName: \"kubernetes.io/projected/b0732fe9-de74-49cf-9db1-3a5ed0b61888-kube-api-access-jjmzz\") pod \"kuadrant-operator-catalog-mm6jk\" (UID: \"b0732fe9-de74-49cf-9db1-3a5ed0b61888\") " pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:32:55.200762 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.200739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjmzz\" (UniqueName: \"kubernetes.io/projected/b0732fe9-de74-49cf-9db1-3a5ed0b61888-kube-api-access-jjmzz\") pod \"kuadrant-operator-catalog-mm6jk\" (UID: \"b0732fe9-de74-49cf-9db1-3a5ed0b61888\") " pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:32:55.210234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.210207 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjmzz\" (UniqueName: \"kubernetes.io/projected/b0732fe9-de74-49cf-9db1-3a5ed0b61888-kube-api-access-jjmzz\") pod \"kuadrant-operator-catalog-mm6jk\" (UID: \"b0732fe9-de74-49cf-9db1-3a5ed0b61888\") " pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:32:55.382491 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.382406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:32:55.490964 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.490931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:32:55.510692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:55.510671 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mm6jk"] Jun 11 19:32:55.512639 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:32:55.512611 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0732fe9_de74_49cf_9db1_3a5ed0b61888.slice/crio-30f029abc94a0c630af70e28e35f05c07885ac624473a5bab7403c8856e886af WatchSource:0}: Error finding container 30f029abc94a0c630af70e28e35f05c07885ac624473a5bab7403c8856e886af: Status 404 returned error can't find the container with id 30f029abc94a0c630af70e28e35f05c07885ac624473a5bab7403c8856e886af Jun 11 19:32:56.007328 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:56.007296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" event={"ID":"b0732fe9-de74-49cf-9db1-3a5ed0b61888","Type":"ContainerStarted","Data":"30f029abc94a0c630af70e28e35f05c07885ac624473a5bab7403c8856e886af"} Jun 11 19:32:58.020622 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.020587 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" event={"ID":"b0732fe9-de74-49cf-9db1-3a5ed0b61888","Type":"ContainerStarted","Data":"452aa998072d9b8834d1a3e7faca6ddc783865610ee2d375052ff5ae4f2b52da"} Jun 11 19:32:58.022125 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.022103 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" event={"ID":"070c232b-abb2-41e1-9804-671e87f416e4","Type":"ContainerStarted","Data":"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8"} Jun 11 19:32:58.022214 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.022187 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" podUID="070c232b-abb2-41e1-9804-671e87f416e4" containerName="registry-server" containerID="cri-o://e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8" gracePeriod=2 Jun 11 19:32:58.038919 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.038881 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" podStartSLOduration=1.023255698 podStartE2EDuration="3.038866009s" totalImagesPullingTime="2.015610311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:58.035622841 +0000 UTC m=+608.751730808" watchObservedRunningTime="2026-06-11 19:32:58.038866009 +0000 UTC m=+608.754973975" Jun 11 19:32:58.052108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.052067 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" podStartSLOduration=1.497726899 podStartE2EDuration="4.052055114s" totalImagesPullingTime="2.554328215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:32:58.050730992 +0000 UTC m=+608.766838957" watchObservedRunningTime="2026-06-11 19:32:58.052055114 +0000 UTC m=+608.768163126" Jun 11 19:32:58.267971 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.267948 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:58.324597 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.324511 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5j6df\" (UniqueName: \"kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df\") pod \"070c232b-abb2-41e1-9804-671e87f416e4\" (UID: \"070c232b-abb2-41e1-9804-671e87f416e4\") " Jun 11 19:32:58.327776 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.327749 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df" (OuterVolumeSpecName: "kube-api-access-5j6df") pod "070c232b-abb2-41e1-9804-671e87f416e4" (UID: "070c232b-abb2-41e1-9804-671e87f416e4"). InnerVolumeSpecName "kube-api-access-5j6df". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:32:58.425923 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:58.425896 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5j6df\" (UniqueName: \"kubernetes.io/projected/070c232b-abb2-41e1-9804-671e87f416e4-kube-api-access-5j6df\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:32:59.028038 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.028000 2562 generic.go:356] "Generic (PLEG): container finished" podID="070c232b-abb2-41e1-9804-671e87f416e4" containerID="e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8" exitCode=0 Jun 11 19:32:59.028522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.028060 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" Jun 11 19:32:59.028522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.028081 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" event={"ID":"070c232b-abb2-41e1-9804-671e87f416e4","Type":"ContainerDied","Data":"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8"} Jun 11 19:32:59.028522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.028151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6m9w8" event={"ID":"070c232b-abb2-41e1-9804-671e87f416e4","Type":"ContainerDied","Data":"ce2147c2792dc30372ae6935ba4bf4d7c169c7e52641a4be604c4ccc0b15cbc1"} Jun 11 19:32:59.028522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.028170 2562 scope.go:117] "RemoveContainer" containerID="e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8" Jun 11 19:32:59.037431 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.037415 2562 scope.go:117] "RemoveContainer" containerID="e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8" Jun 11 19:32:59.037685 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:32:59.037668 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8\": container with ID starting with e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8 not found: ID does not exist" containerID="e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8" Jun 11 19:32:59.037750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.037692 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8"} err="failed to get container status \"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8\": rpc error: code = NotFound desc = could not find container \"e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8\": container with ID starting with e61d8b309112dee1ab1ec8b41c5589be9f03d4b44536aad7c1b7497c8874f8a8 not found: ID does not exist" Jun 11 19:32:59.057879 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.057851 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:59.060428 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.060407 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6m9w8"] Jun 11 19:32:59.721168 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:32:59.721136 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="070c232b-abb2-41e1-9804-671e87f416e4" path="/var/lib/kubelet/pods/070c232b-abb2-41e1-9804-671e87f416e4/volumes" Jun 11 19:33:05.383136 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:05.383104 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:33:05.383628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:05.383186 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:33:05.405603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:05.405579 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:33:06.083220 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:06.083194 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mm6jk" Jun 11 19:33:09.115289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.115255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:09.187242 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.187205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:09.471610 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.471582 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz"] Jun 11 19:33:09.471922 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.471909 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="070c232b-abb2-41e1-9804-671e87f416e4" containerName="registry-server" Jun 11 19:33:09.472018 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.471923 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="070c232b-abb2-41e1-9804-671e87f416e4" containerName="registry-server" Jun 11 19:33:09.472018 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.471979 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="070c232b-abb2-41e1-9804-671e87f416e4" containerName="registry-server" Jun 11 19:33:09.485997 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.485955 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.486358 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.486326 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz"] Jun 11 19:33:09.488935 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.488911 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9rvd6\"" Jun 11 19:33:09.503861 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.503839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx8p4\" (UniqueName: \"kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.503957 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.503873 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.503957 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.503895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.604386 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.604354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rx8p4\" (UniqueName: \"kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.604572 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.604395 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.604572 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.604433 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.604804 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.604785 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.604872 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.604847 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.613786 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.613762 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx8p4\" (UniqueName: \"kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.796266 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.796184 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:09.935710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:09.935677 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz"] Jun 11 19:33:09.936660 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:09.936632 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679bcdaa_a8ea_46cb_9295_9da49aa623b5.slice/crio-81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a WatchSource:0}: Error finding container 81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a: Status 404 returned error can't find the container with id 81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a Jun 11 19:33:10.082112 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.082039 2562 generic.go:356] "Generic (PLEG): container finished" podID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerID="d83dd30b9bda767e0f51f18972284e37509e434f988a3162a45b3be0b4cd66fc" exitCode=0 Jun 11 19:33:10.082112 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.082096 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" event={"ID":"679bcdaa-a8ea-46cb-9295-9da49aa623b5","Type":"ContainerDied","Data":"d83dd30b9bda767e0f51f18972284e37509e434f988a3162a45b3be0b4cd66fc"} Jun 11 19:33:10.082294 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.082158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" event={"ID":"679bcdaa-a8ea-46cb-9295-9da49aa623b5","Type":"ContainerStarted","Data":"81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a"} Jun 11 19:33:10.082692 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.082674 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:33:10.277303 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.277261 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9"] Jun 11 19:33:10.280851 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.280835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.298804 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.298782 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9"] Jun 11 19:33:10.309635 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.309610 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.309737 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.309660 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.309737 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.309715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7p5\" (UniqueName: \"kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.410893 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.410810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.410893 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.410864 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.411080 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.410990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7p5\" (UniqueName: \"kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.411204 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.411190 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.411243 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.411225 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.419885 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.419856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7p5\" (UniqueName: \"kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.589583 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.589553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:10.731672 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.731650 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9"] Jun 11 19:33:10.734998 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:10.734962 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbc1400a_8968_4be7_99e6_ff5d5b597140.slice/crio-6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f WatchSource:0}: Error finding container 6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f: Status 404 returned error can't find the container with id 6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f Jun 11 19:33:10.882037 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.882013 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5"] Jun 11 19:33:10.885398 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.885382 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:10.896637 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.896619 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5"] Jun 11 19:33:10.915286 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.915267 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:10.915379 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.915296 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:10.915420 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:10.915383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxdtv\" (UniqueName: \"kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.016694 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.016652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxdtv\" (UniqueName: \"kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.016877 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.016710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.016877 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.016824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.017097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.017078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.017145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.017130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.028593 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.028572 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxdtv\" (UniqueName: \"kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.088960 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.088937 2562 generic.go:356] "Generic (PLEG): container finished" podID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerID="e390097f8505f4ab2660b84533d53de894e101a32b0be9bf88e923944f71a427" exitCode=0 Jun 11 19:33:11.089055 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.089023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" event={"ID":"dbc1400a-8968-4be7-99e6-ff5d5b597140","Type":"ContainerDied","Data":"e390097f8505f4ab2660b84533d53de894e101a32b0be9bf88e923944f71a427"} Jun 11 19:33:11.089119 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.089072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" event={"ID":"dbc1400a-8968-4be7-99e6-ff5d5b597140","Type":"ContainerStarted","Data":"6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f"} Jun 11 19:33:11.090893 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.090874 2562 generic.go:356] "Generic (PLEG): container finished" podID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerID="1b4451bd1a4132c0389e6c5b5bdd69067b1a30540de90e24d308a8f85ac4a07e" exitCode=0 Jun 11 19:33:11.090995 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.090949 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" event={"ID":"679bcdaa-a8ea-46cb-9295-9da49aa623b5","Type":"ContainerDied","Data":"1b4451bd1a4132c0389e6c5b5bdd69067b1a30540de90e24d308a8f85ac4a07e"} Jun 11 19:33:11.251403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.251366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:11.270900 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.270872 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq"] Jun 11 19:33:11.274743 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.274724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.286399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.286377 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq"] Jun 11 19:33:11.319656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.319629 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zps95\" (UniqueName: \"kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.319783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.319690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.319783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.319721 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.392431 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.392406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5"] Jun 11 19:33:11.394969 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:11.394944 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1248043_2548_40ce_b9c9_fedacea58353.slice/crio-bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a WatchSource:0}: Error finding container bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a: Status 404 returned error can't find the container with id bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a Jun 11 19:33:11.421024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.420579 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zps95\" (UniqueName: \"kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.421024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.420751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.421024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.420806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.422058 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.421274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.422058 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.421482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.429949 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.429927 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zps95\" (UniqueName: \"kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.584176 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.584144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:11.721961 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:11.721918 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod913c2381_1207_4d78_b49f_2e8050479fb9.slice/crio-3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8 WatchSource:0}: Error finding container 3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8: Status 404 returned error can't find the container with id 3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8 Jun 11 19:33:11.724265 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:11.724243 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq"] Jun 11 19:33:12.099200 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.099132 2562 generic.go:356] "Generic (PLEG): container finished" podID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerID="5a3008662e0842b6596a9de66a1e951ffabdb9a0007c548b0b287d2c6af15aa3" exitCode=0 Jun 11 19:33:12.099343 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.099213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" event={"ID":"679bcdaa-a8ea-46cb-9295-9da49aa623b5","Type":"ContainerDied","Data":"5a3008662e0842b6596a9de66a1e951ffabdb9a0007c548b0b287d2c6af15aa3"} Jun 11 19:33:12.100599 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.100577 2562 generic.go:356] "Generic (PLEG): container finished" podID="913c2381-1207-4d78-b49f-2e8050479fb9" containerID="86c9dfd80328840196b48b463cf323080f8bb3fd17b5637a79f115c8187abc6d" exitCode=0 Jun 11 19:33:12.100715 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.100637 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" event={"ID":"913c2381-1207-4d78-b49f-2e8050479fb9","Type":"ContainerDied","Data":"86c9dfd80328840196b48b463cf323080f8bb3fd17b5637a79f115c8187abc6d"} Jun 11 19:33:12.100715 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.100672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" event={"ID":"913c2381-1207-4d78-b49f-2e8050479fb9","Type":"ContainerStarted","Data":"3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8"} Jun 11 19:33:12.102060 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.102037 2562 generic.go:356] "Generic (PLEG): container finished" podID="a1248043-2548-40ce-b9c9-fedacea58353" containerID="2e3d12b883d9c478c790053566f78491d14a65b9b0a6e0d3c1f1f5721b1d93cc" exitCode=0 Jun 11 19:33:12.102138 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.102114 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" event={"ID":"a1248043-2548-40ce-b9c9-fedacea58353","Type":"ContainerDied","Data":"2e3d12b883d9c478c790053566f78491d14a65b9b0a6e0d3c1f1f5721b1d93cc"} Jun 11 19:33:12.102193 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:12.102163 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" event={"ID":"a1248043-2548-40ce-b9c9-fedacea58353","Type":"ContainerStarted","Data":"bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a"} Jun 11 19:33:13.109082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.109055 2562 generic.go:356] "Generic (PLEG): container finished" podID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerID="5fb1fbe60eb1a18dfbf66918c432418e58ed6b408c7910fd91f841f1f4b9b131" exitCode=0 Jun 11 19:33:13.109435 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.109132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" event={"ID":"dbc1400a-8968-4be7-99e6-ff5d5b597140","Type":"ContainerDied","Data":"5fb1fbe60eb1a18dfbf66918c432418e58ed6b408c7910fd91f841f1f4b9b131"} Jun 11 19:33:13.111017 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.110997 2562 generic.go:356] "Generic (PLEG): container finished" podID="a1248043-2548-40ce-b9c9-fedacea58353" containerID="84fd508faaf0034c599dca22c9ca4171478f5b3af10c0210263b4bb1ae9240ef" exitCode=0 Jun 11 19:33:13.111094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.111064 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" event={"ID":"a1248043-2548-40ce-b9c9-fedacea58353","Type":"ContainerDied","Data":"84fd508faaf0034c599dca22c9ca4171478f5b3af10c0210263b4bb1ae9240ef"} Jun 11 19:33:13.247231 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.247204 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:13.336469 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.336444 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle\") pod \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " Jun 11 19:33:13.336585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.336508 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util\") pod \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " Jun 11 19:33:13.336585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.336538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rx8p4\" (UniqueName: \"kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4\") pod \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\" (UID: \"679bcdaa-a8ea-46cb-9295-9da49aa623b5\") " Jun 11 19:33:13.337011 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.336977 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle" (OuterVolumeSpecName: "bundle") pod "679bcdaa-a8ea-46cb-9295-9da49aa623b5" (UID: "679bcdaa-a8ea-46cb-9295-9da49aa623b5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:13.338640 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.338615 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4" (OuterVolumeSpecName: "kube-api-access-rx8p4") pod "679bcdaa-a8ea-46cb-9295-9da49aa623b5" (UID: "679bcdaa-a8ea-46cb-9295-9da49aa623b5"). InnerVolumeSpecName "kube-api-access-rx8p4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:13.341985 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.341955 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util" (OuterVolumeSpecName: "util") pod "679bcdaa-a8ea-46cb-9295-9da49aa623b5" (UID: "679bcdaa-a8ea-46cb-9295-9da49aa623b5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:13.437607 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.437585 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rx8p4\" (UniqueName: \"kubernetes.io/projected/679bcdaa-a8ea-46cb-9295-9da49aa623b5-kube-api-access-rx8p4\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:13.437607 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.437607 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:13.437749 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:13.437615 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/679bcdaa-a8ea-46cb-9295-9da49aa623b5-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:14.117990 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.117909 2562 generic.go:356] "Generic (PLEG): container finished" podID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerID="f9fb565ea57dffef571b9217e79ae8838a34490d4a0a17dda2ab52bcee5e5f53" exitCode=0 Jun 11 19:33:14.118399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.117992 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" event={"ID":"dbc1400a-8968-4be7-99e6-ff5d5b597140","Type":"ContainerDied","Data":"f9fb565ea57dffef571b9217e79ae8838a34490d4a0a17dda2ab52bcee5e5f53"} Jun 11 19:33:14.119856 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.119829 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" Jun 11 19:33:14.119967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.119825 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz" event={"ID":"679bcdaa-a8ea-46cb-9295-9da49aa623b5","Type":"ContainerDied","Data":"81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a"} Jun 11 19:33:14.119967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.119952 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81be1a10d6e763452eea350e19b3b23208c41736751a3aa33f4c1cd2fb58f09a" Jun 11 19:33:14.121834 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.121809 2562 generic.go:356] "Generic (PLEG): container finished" podID="913c2381-1207-4d78-b49f-2e8050479fb9" containerID="0ec5e86017d49b222015515e6dac91604ae113701567e1e9d01cd092951f20e7" exitCode=0 Jun 11 19:33:14.121955 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.121884 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" event={"ID":"913c2381-1207-4d78-b49f-2e8050479fb9","Type":"ContainerDied","Data":"0ec5e86017d49b222015515e6dac91604ae113701567e1e9d01cd092951f20e7"} Jun 11 19:33:14.126226 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.126199 2562 generic.go:356] "Generic (PLEG): container finished" podID="a1248043-2548-40ce-b9c9-fedacea58353" containerID="3d9d8ae9f4bbe351085a549f62ff89a938f676968380f35d085cfe4c7f504d23" exitCode=0 Jun 11 19:33:14.126342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:14.126236 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" event={"ID":"a1248043-2548-40ce-b9c9-fedacea58353","Type":"ContainerDied","Data":"3d9d8ae9f4bbe351085a549f62ff89a938f676968380f35d085cfe4c7f504d23"} Jun 11 19:33:15.133805 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.133768 2562 generic.go:356] "Generic (PLEG): container finished" podID="913c2381-1207-4d78-b49f-2e8050479fb9" containerID="b65cc5261838579355a22d28c2270b228242bfe2c5a8c52da44edf93aa30731c" exitCode=0 Jun 11 19:33:15.134439 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.133852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" event={"ID":"913c2381-1207-4d78-b49f-2e8050479fb9","Type":"ContainerDied","Data":"b65cc5261838579355a22d28c2270b228242bfe2c5a8c52da44edf93aa30731c"} Jun 11 19:33:15.296023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.295991 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:15.298721 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.298701 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:15.352425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352399 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util\") pod \"dbc1400a-8968-4be7-99e6-ff5d5b597140\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " Jun 11 19:33:15.352588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352443 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util\") pod \"a1248043-2548-40ce-b9c9-fedacea58353\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " Jun 11 19:33:15.352588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352494 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle\") pod \"a1248043-2548-40ce-b9c9-fedacea58353\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " Jun 11 19:33:15.352588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352513 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxdtv\" (UniqueName: \"kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv\") pod \"a1248043-2548-40ce-b9c9-fedacea58353\" (UID: \"a1248043-2548-40ce-b9c9-fedacea58353\") " Jun 11 19:33:15.352588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352536 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc7p5\" (UniqueName: \"kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5\") pod \"dbc1400a-8968-4be7-99e6-ff5d5b597140\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " Jun 11 19:33:15.352803 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.352639 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle\") pod \"dbc1400a-8968-4be7-99e6-ff5d5b597140\" (UID: \"dbc1400a-8968-4be7-99e6-ff5d5b597140\") " Jun 11 19:33:15.353109 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.353083 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle" (OuterVolumeSpecName: "bundle") pod "a1248043-2548-40ce-b9c9-fedacea58353" (UID: "a1248043-2548-40ce-b9c9-fedacea58353"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:15.353357 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.353275 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle" (OuterVolumeSpecName: "bundle") pod "dbc1400a-8968-4be7-99e6-ff5d5b597140" (UID: "dbc1400a-8968-4be7-99e6-ff5d5b597140"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:15.354878 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.354848 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5" (OuterVolumeSpecName: "kube-api-access-pc7p5") pod "dbc1400a-8968-4be7-99e6-ff5d5b597140" (UID: "dbc1400a-8968-4be7-99e6-ff5d5b597140"). InnerVolumeSpecName "kube-api-access-pc7p5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:15.355065 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.355049 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv" (OuterVolumeSpecName: "kube-api-access-hxdtv") pod "a1248043-2548-40ce-b9c9-fedacea58353" (UID: "a1248043-2548-40ce-b9c9-fedacea58353"). InnerVolumeSpecName "kube-api-access-hxdtv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:15.358634 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.358601 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util" (OuterVolumeSpecName: "util") pod "a1248043-2548-40ce-b9c9-fedacea58353" (UID: "a1248043-2548-40ce-b9c9-fedacea58353"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:15.359304 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.359285 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util" (OuterVolumeSpecName: "util") pod "dbc1400a-8968-4be7-99e6-ff5d5b597140" (UID: "dbc1400a-8968-4be7-99e6-ff5d5b597140"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:15.453254 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453224 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:15.453254 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453251 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a1248043-2548-40ce-b9c9-fedacea58353-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:15.453414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453261 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxdtv\" (UniqueName: \"kubernetes.io/projected/a1248043-2548-40ce-b9c9-fedacea58353-kube-api-access-hxdtv\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:15.453414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453271 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc7p5\" (UniqueName: \"kubernetes.io/projected/dbc1400a-8968-4be7-99e6-ff5d5b597140-kube-api-access-pc7p5\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:15.453414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453280 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:15.453414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:15.453288 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dbc1400a-8968-4be7-99e6-ff5d5b597140-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:16.141423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.141345 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" Jun 11 19:33:16.141423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.141355 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9" event={"ID":"dbc1400a-8968-4be7-99e6-ff5d5b597140","Type":"ContainerDied","Data":"6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f"} Jun 11 19:33:16.141423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.141395 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6408a3aba4ccaa808831c2510e3c1ecfe0fb4a8640a0074f72aed1dda4c0250f" Jun 11 19:33:16.143438 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.143313 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" Jun 11 19:33:16.143438 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.143343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5" event={"ID":"a1248043-2548-40ce-b9c9-fedacea58353","Type":"ContainerDied","Data":"bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a"} Jun 11 19:33:16.143438 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.143395 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bba3811659b8e6a4c9b0e32815abd2b3f527297760bcbf8b3b52e3e7132fa46a" Jun 11 19:33:16.269665 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.269642 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:16.361094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.361069 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util\") pod \"913c2381-1207-4d78-b49f-2e8050479fb9\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " Jun 11 19:33:16.361240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.361126 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle\") pod \"913c2381-1207-4d78-b49f-2e8050479fb9\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " Jun 11 19:33:16.361240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.361193 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zps95\" (UniqueName: \"kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95\") pod \"913c2381-1207-4d78-b49f-2e8050479fb9\" (UID: \"913c2381-1207-4d78-b49f-2e8050479fb9\") " Jun 11 19:33:16.361741 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.361712 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle" (OuterVolumeSpecName: "bundle") pod "913c2381-1207-4d78-b49f-2e8050479fb9" (UID: "913c2381-1207-4d78-b49f-2e8050479fb9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:16.363702 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.363670 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95" (OuterVolumeSpecName: "kube-api-access-zps95") pod "913c2381-1207-4d78-b49f-2e8050479fb9" (UID: "913c2381-1207-4d78-b49f-2e8050479fb9"). InnerVolumeSpecName "kube-api-access-zps95". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:16.366514 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.366491 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util" (OuterVolumeSpecName: "util") pod "913c2381-1207-4d78-b49f-2e8050479fb9" (UID: "913c2381-1207-4d78-b49f-2e8050479fb9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:16.462368 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.462344 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zps95\" (UniqueName: \"kubernetes.io/projected/913c2381-1207-4d78-b49f-2e8050479fb9-kube-api-access-zps95\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:16.462368 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.462365 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:16.462530 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:16.462374 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/913c2381-1207-4d78-b49f-2e8050479fb9-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:17.156978 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:17.156951 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" Jun 11 19:33:17.157395 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:17.156946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq" event={"ID":"913c2381-1207-4d78-b49f-2e8050479fb9","Type":"ContainerDied","Data":"3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8"} Jun 11 19:33:17.157395 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:17.157091 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e7a8101569e8b34033012d5ac74b8d56a6bda9575bc4bcf0b0abc3e4a34f4b8" Jun 11 19:33:19.914887 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:19.914860 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:20.010862 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:20.010827 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:20.094346 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:20.094311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:23.123212 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:23.123182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:26.635967 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:26.635900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:27.980991 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.980956 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw"] Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981274 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981285 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981296 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981302 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981312 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981317 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981325 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981329 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981342 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981346 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981352 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981357 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981367 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981372 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="extract" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981377 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981382 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="util" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981389 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981393 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="pull" Jun 11 19:33:27.981391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981399 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="extract" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981404 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="extract" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981410 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="util" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981415 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="util" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981423 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="pull" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981428 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="pull" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981493 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="913c2381-1207-4d78-b49f-2e8050479fb9" containerName="extract" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981502 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbc1400a-8968-4be7-99e6-ff5d5b597140" containerName="extract" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981507 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1248043-2548-40ce-b9c9-fedacea58353" containerName="extract" Jun 11 19:33:27.982047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.981515 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="679bcdaa-a8ea-46cb-9295-9da49aa623b5" containerName="extract" Jun 11 19:33:27.985646 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.985629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:27.988411 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.988394 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-f9g2n\"" Jun 11 19:33:27.997292 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:27.997267 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw"] Jun 11 19:33:28.056946 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.056915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.056946 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.056946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlfnb\" (UniqueName: \"kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.158366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.158333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.158366 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.158369 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlfnb\" (UniqueName: \"kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.158748 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.158726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.170737 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.170716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlfnb\" (UniqueName: \"kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.296307 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.296215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:28.452190 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.452166 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw"] Jun 11 19:33:28.452774 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:28.452744 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31ae944_01ce_4ab5_aa5e_b7eaafad50a9.slice/crio-dc78b5478de9cd967c4834561c48f83beb95b474352cbc2eeafb057889a9ee3f WatchSource:0}: Error finding container dc78b5478de9cd967c4834561c48f83beb95b474352cbc2eeafb057889a9ee3f: Status 404 returned error can't find the container with id dc78b5478de9cd967c4834561c48f83beb95b474352cbc2eeafb057889a9ee3f Jun 11 19:33:28.541829 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:28.541795 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:29.217629 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:29.217598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" event={"ID":"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9","Type":"ContainerStarted","Data":"dc78b5478de9cd967c4834561c48f83beb95b474352cbc2eeafb057889a9ee3f"} Jun 11 19:33:30.152217 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:30.152180 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:30.533285 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:30.533241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:32.004772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.004723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:32.373087 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.373003 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tdw94"] Jun 11 19:33:32.381768 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.381746 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:32.384495 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.384476 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-qsc49\"" Jun 11 19:33:32.389121 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.389096 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tdw94"] Jun 11 19:33:32.494593 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.494564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml958\" (UniqueName: \"kubernetes.io/projected/193ecfe1-91d6-464c-951e-a9509c09ef20-kube-api-access-ml958\") pod \"authorino-operator-75cc8d5cb7-tdw94\" (UID: \"193ecfe1-91d6-464c-951e-a9509c09ef20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:32.595816 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.595750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml958\" (UniqueName: \"kubernetes.io/projected/193ecfe1-91d6-464c-951e-a9509c09ef20-kube-api-access-ml958\") pod \"authorino-operator-75cc8d5cb7-tdw94\" (UID: \"193ecfe1-91d6-464c-951e-a9509c09ef20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:32.607482 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.607440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml958\" (UniqueName: \"kubernetes.io/projected/193ecfe1-91d6-464c-951e-a9509c09ef20-kube-api-access-ml958\") pod \"authorino-operator-75cc8d5cb7-tdw94\" (UID: \"193ecfe1-91d6-464c-951e-a9509c09ef20\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:32.696264 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.696232 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:32.848445 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:32.848416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-tdw94"] Jun 11 19:33:32.849494 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:32.849443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod193ecfe1_91d6_464c_951e_a9509c09ef20.slice/crio-02e20b282fefe118f17c48cd2874807128694e4ab8e65d94c706726ed428286b WatchSource:0}: Error finding container 02e20b282fefe118f17c48cd2874807128694e4ab8e65d94c706726ed428286b: Status 404 returned error can't find the container with id 02e20b282fefe118f17c48cd2874807128694e4ab8e65d94c706726ed428286b Jun 11 19:33:33.242165 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:33.242119 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" event={"ID":"193ecfe1-91d6-464c-951e-a9509c09ef20","Type":"ContainerStarted","Data":"02e20b282fefe118f17c48cd2874807128694e4ab8e65d94c706726ed428286b"} Jun 11 19:33:33.574674 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:33.574590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:34.405614 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:34.405576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:34.521704 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:34.521660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:36.267296 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.267263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" event={"ID":"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9","Type":"ContainerStarted","Data":"b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4"} Jun 11 19:33:36.267744 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.267444 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:36.268866 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.268837 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" event={"ID":"193ecfe1-91d6-464c-951e-a9509c09ef20","Type":"ContainerStarted","Data":"c1b76a748283c0f6fb21539b94eac8d8ffa7b1f1b372f29c2bcd015c0eb585e1"} Jun 11 19:33:36.268979 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.268964 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:36.295123 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.295080 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" podStartSLOduration=2.102458656 podStartE2EDuration="9.295066388s" totalImagesPullingTime="7.192607732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:33:36.293914764 +0000 UTC m=+647.010022732" watchObservedRunningTime="2026-06-11 19:33:36.295066388 +0000 UTC m=+647.011174352" Jun 11 19:33:36.319610 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.319554 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" podStartSLOduration=1.489347243 podStartE2EDuration="4.319529549s" totalImagesPullingTime="2.830182306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:33:36.318533665 +0000 UTC m=+647.034641638" watchObservedRunningTime="2026-06-11 19:33:36.319529549 +0000 UTC m=+647.035637513" Jun 11 19:33:36.416164 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:36.416129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:38.348041 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:38.347996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:38.437689 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:38.437659 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:38.775035 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:38.774999 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:45.754318 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:45.754278 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:45.878859 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:45.878820 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:47.277356 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:47.277327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-tdw94" Jun 11 19:33:47.277773 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:47.277504 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:47.364584 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:47.364539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:47.466836 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:47.466804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:48.957648 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.957609 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw"] Jun 11 19:33:48.958094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.957837 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" containerName="manager" containerID="cri-o://b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4" gracePeriod=2 Jun 11 19:33:48.968822 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.968793 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw"] Jun 11 19:33:48.977170 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:48.977140 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\": pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:48.991568 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.991541 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:33:48.992046 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.992031 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" containerName="manager" Jun 11 19:33:48.992089 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.992049 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" containerName="manager" Jun 11 19:33:48.992151 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.992141 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" containerName="manager" Jun 11 19:33:48.995444 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:48.995427 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:48.997814 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:48.997777 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" is forbidden: User \"system:node:ip-10-0-140-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-225.ec2.internal' and this object" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.015533 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.015512 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:33:49.135003 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.134968 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph58n\" (UniqueName: \"kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.135155 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.135029 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.200414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.200392 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.202683 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:49.202659 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" is forbidden: User \"system:node:ip-10-0-140-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-225.ec2.internal' and this object" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.236090 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.236033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph58n\" (UniqueName: \"kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.236090 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.236077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.236383 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.236368 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.245849 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.245818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph58n\" (UniqueName: \"kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tn7xm\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.336425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.336391 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume\") pod \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " Jun 11 19:33:49.336642 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.336520 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rlfnb\" (UniqueName: \"kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb\") pod \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\" (UID: \"d31ae944-01ce-4ab5-aa5e-b7eaafad50a9\") " Jun 11 19:33:49.336987 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.336963 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" (UID: "d31ae944-01ce-4ab5-aa5e-b7eaafad50a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:33:49.338882 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.338853 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb" (OuterVolumeSpecName: "kube-api-access-rlfnb") pod "d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" (UID: "d31ae944-01ce-4ab5-aa5e-b7eaafad50a9"). InnerVolumeSpecName "kube-api-access-rlfnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:33:49.342543 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.342520 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:49.343387 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.343364 2562 generic.go:356] "Generic (PLEG): container finished" podID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" containerID="b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4" exitCode=0 Jun 11 19:33:49.343487 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.343398 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.343536 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.343481 2562 scope.go:117] "RemoveContainer" containerID="b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4" Jun 11 19:33:49.348871 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:49.348838 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" is forbidden: User \"system:node:ip-10-0-140-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-225.ec2.internal' and this object" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.355928 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.355912 2562 scope.go:117] "RemoveContainer" containerID="b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4" Jun 11 19:33:49.356116 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:49.356092 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" is forbidden: User \"system:node:ip-10-0-140-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-225.ec2.internal' and this object" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.356240 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:49.356222 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4\": container with ID starting with b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4 not found: ID does not exist" containerID="b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4" Jun 11 19:33:49.356289 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.356249 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4"} err="failed to get container status \"b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4\": rpc error: code = NotFound desc = could not find container \"b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4\": container with ID starting with b8558354e987951f17160ce9610593a1afd37d864846ea7509777d40c3651ab4 not found: ID does not exist" Jun 11 19:33:49.438027 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.437989 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rlfnb\" (UniqueName: \"kubernetes.io/projected/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-kube-api-access-rlfnb\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:49.438169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.438031 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9-extensions-socket-volume\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:33:49.504066 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.504039 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:33:49.505080 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:33:49.505057 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74859993_a8cf_42da_bf84_d46aa5a7b5e6.slice/crio-258345c00dd1d61caf50fbead55acd51ec9c69ef4cd637f794e330ae96450b74 WatchSource:0}: Error finding container 258345c00dd1d61caf50fbead55acd51ec9c69ef4cd637f794e330ae96450b74: Status 404 returned error can't find the container with id 258345c00dd1d61caf50fbead55acd51ec9c69ef4cd637f794e330ae96450b74 Jun 11 19:33:49.722858 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:33:49.722824 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bq9lw\" is forbidden: User \"system:node:ip-10-0-140-225.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-225.ec2.internal' and this object" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bq9lw" Jun 11 19:33:49.723411 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:49.723390 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31ae944-01ce-4ab5-aa5e-b7eaafad50a9" path="/var/lib/kubelet/pods/d31ae944-01ce-4ab5-aa5e-b7eaafad50a9/volumes" Jun 11 19:33:50.350261 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.350226 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" event={"ID":"74859993-a8cf-42da-bf84-d46aa5a7b5e6","Type":"ContainerStarted","Data":"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d"} Jun 11 19:33:50.350664 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.350311 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:33:50.350664 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.350332 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" event={"ID":"74859993-a8cf-42da-bf84-d46aa5a7b5e6","Type":"ContainerStarted","Data":"258345c00dd1d61caf50fbead55acd51ec9c69ef4cd637f794e330ae96450b74"} Jun 11 19:33:50.396222 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.396169 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" podStartSLOduration=2.396153074 podStartE2EDuration="2.396153074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:33:50.393491988 +0000 UTC m=+661.109599944" watchObservedRunningTime="2026-06-11 19:33:50.396153074 +0000 UTC m=+661.112261039" Jun 11 19:33:50.654536 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.654419 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:50.761628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.761596 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:50.879095 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:50.879044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:53.020016 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:53.019980 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:53.120193 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:53.120154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:58.556276 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:58.556238 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:33:58.654294 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:33:58.654257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:01.357414 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:01.357380 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:34:05.574022 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:05.573988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:05.667750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:05.667714 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:08.474748 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:08.474709 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:34:08.475252 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:08.474899 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" podUID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" containerName="manager" containerID="cri-o://20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d" gracePeriod=10 Jun 11 19:34:09.025587 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.025559 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:34:09.109600 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.109514 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ph58n\" (UniqueName: \"kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n\") pod \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " Jun 11 19:34:09.109600 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.109558 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume\") pod \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\" (UID: \"74859993-a8cf-42da-bf84-d46aa5a7b5e6\") " Jun 11 19:34:09.109948 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.109924 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "74859993-a8cf-42da-bf84-d46aa5a7b5e6" (UID: "74859993-a8cf-42da-bf84-d46aa5a7b5e6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:34:09.111783 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.111757 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n" (OuterVolumeSpecName: "kube-api-access-ph58n") pod "74859993-a8cf-42da-bf84-d46aa5a7b5e6" (UID: "74859993-a8cf-42da-bf84-d46aa5a7b5e6"). InnerVolumeSpecName "kube-api-access-ph58n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:09.210566 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.210532 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ph58n\" (UniqueName: \"kubernetes.io/projected/74859993-a8cf-42da-bf84-d46aa5a7b5e6-kube-api-access-ph58n\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:34:09.210566 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.210560 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74859993-a8cf-42da-bf84-d46aa5a7b5e6-extensions-socket-volume\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:34:09.450801 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.450765 2562 generic.go:356] "Generic (PLEG): container finished" podID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" containerID="20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d" exitCode=0 Jun 11 19:34:09.451004 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.450813 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" Jun 11 19:34:09.451004 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.450856 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" event={"ID":"74859993-a8cf-42da-bf84-d46aa5a7b5e6","Type":"ContainerDied","Data":"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d"} Jun 11 19:34:09.451004 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.450927 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm" event={"ID":"74859993-a8cf-42da-bf84-d46aa5a7b5e6","Type":"ContainerDied","Data":"258345c00dd1d61caf50fbead55acd51ec9c69ef4cd637f794e330ae96450b74"} Jun 11 19:34:09.451004 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.450957 2562 scope.go:117] "RemoveContainer" containerID="20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d" Jun 11 19:34:09.462429 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.462407 2562 scope.go:117] "RemoveContainer" containerID="20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d" Jun 11 19:34:09.463183 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:34:09.463159 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d\": container with ID starting with 20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d not found: ID does not exist" containerID="20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d" Jun 11 19:34:09.463270 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.463191 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d"} err="failed to get container status \"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d\": rpc error: code = NotFound desc = could not find container \"20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d\": container with ID starting with 20be436ddc89c18936ee059195139c6aa0e69552023101614eebed3933d6019d not found: ID does not exist" Jun 11 19:34:09.475522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.475493 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:34:09.478725 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.478701 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tn7xm"] Jun 11 19:34:09.721984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:09.721902 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" path="/var/lib/kubelet/pods/74859993-a8cf-42da-bf84-d46aa5a7b5e6/volumes" Jun 11 19:34:10.367880 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:10.367847 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:10.464050 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:10.464019 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:10.541118 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:10.541085 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:12.809698 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:12.809665 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:12.906709 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:12.906681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:18.715091 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:18.715052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:18.819327 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:18.819285 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:24.998111 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:24.998076 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph"] Jun 11 19:34:24.998583 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:24.998568 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" containerName="manager" Jun 11 19:34:24.998644 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:24.998587 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" containerName="manager" Jun 11 19:34:24.998680 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:24.998672 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="74859993-a8cf-42da-bf84-d46aa5a7b5e6" containerName="manager" Jun 11 19:34:25.001537 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.001522 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.005332 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.005313 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-8mvnk\"" Jun 11 19:34:25.025074 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.025043 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph"] Jun 11 19:34:25.030703 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.030674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.043077 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043056 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043159 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043244 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043283 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043283 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043276 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043362 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043333 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-kube-api-access-b5x57\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.043413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.043383 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef82b20-cb11-4a33-834f-4052b67621e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.144729 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144698 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.144929 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.144929 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.144929 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-kube-api-access-b5x57\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145086 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145086 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.144971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef82b20-cb11-4a33-834f-4052b67621e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145086 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145021 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145086 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145076 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145296 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145296 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145296 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145221 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145440 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145440 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.145748 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.145628 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ef82b20-cb11-4a33-834f-4052b67621e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.147343 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.147321 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.147441 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.147356 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.154108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.154082 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.154215 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.154150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5x57\" (UniqueName: \"kubernetes.io/projected/5ef82b20-cb11-4a33-834f-4052b67621e3-kube-api-access-b5x57\") pod \"maas-default-gateway-openshift-default-687ff6996-p2sph\" (UID: \"5ef82b20-cb11-4a33-834f-4052b67621e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.311530 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.311426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:25.452554 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.452527 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph"] Jun 11 19:34:25.453517 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:34:25.453487 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ef82b20_cb11_4a33_834f_4052b67621e3.slice/crio-a4604767a8e4d323877725745e72eb3f69b7203b8d052c2315d6f44c77117ffb WatchSource:0}: Error finding container a4604767a8e4d323877725745e72eb3f69b7203b8d052c2315d6f44c77117ffb: Status 404 returned error can't find the container with id a4604767a8e4d323877725745e72eb3f69b7203b8d052c2315d6f44c77117ffb Jun 11 19:34:25.455687 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.455648 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:34:25.455779 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.455734 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:34:25.455818 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.455773 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:34:25.541520 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.541488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" event={"ID":"5ef82b20-cb11-4a33-834f-4052b67621e3","Type":"ContainerStarted","Data":"3febfbe5bbcbcaf1f11c6d0966cf9bbdcf3894d5eebbb418615821648a47ebd6"} Jun 11 19:34:25.541665 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.541546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" event={"ID":"5ef82b20-cb11-4a33-834f-4052b67621e3","Type":"ContainerStarted","Data":"a4604767a8e4d323877725745e72eb3f69b7203b8d052c2315d6f44c77117ffb"} Jun 11 19:34:25.566552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.566445 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podStartSLOduration=1.566426092 podStartE2EDuration="1.566426092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:25.565605032 +0000 UTC m=+696.281712999" watchObservedRunningTime="2026-06-11 19:34:25.566426092 +0000 UTC m=+696.282534058" Jun 11 19:34:25.684740 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.684706 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:25.988886 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:25.988836 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.090347 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.090315 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.311799 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.311726 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:26.316614 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.316592 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:26.547160 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.547131 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:26.548093 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.548073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:34:26.742659 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.742614 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.743947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.743922 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:26.746536 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.746519 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.749141 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.749117 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 19:34:26.749235 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.749176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9rvd6\"" Jun 11 19:34:26.757403 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.757380 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:26.837164 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.837117 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:26.856476 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.856435 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.861496 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.861450 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.861625 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.861541 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv6cd\" (UniqueName: \"kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.918000 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.917935 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:26.962549 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.962512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.962716 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.962563 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv6cd\" (UniqueName: \"kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.963118 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.963100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:26.971898 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:26.971875 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv6cd\" (UniqueName: \"kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd\") pod \"limitador-limitador-64c94fd64f-5jnnh\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:27.057573 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.057476 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:27.198523 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.197158 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:27.553923 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.553891 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" event={"ID":"42b114b0-ea9d-4b6d-bebe-dbfebd98b945","Type":"ContainerStarted","Data":"ef15e4033bcc96361cce2f9cb2d14416e1b3526d7dd771526921b4c9c9e88ed5"} Jun 11 19:34:27.584980 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.584945 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:27.588597 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.588580 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:27.591780 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.591763 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m2dgv\"" Jun 11 19:34:27.595921 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.595896 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:27.624598 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.624565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:27.668663 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.668622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trdg8\" (UniqueName: \"kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8\") pod \"authorino-58cd955675-j9dk8\" (UID: \"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5\") " pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:27.725594 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.725559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:27.769750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.769722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trdg8\" (UniqueName: \"kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8\") pod \"authorino-58cd955675-j9dk8\" (UID: \"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5\") " pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:27.781805 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.781779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trdg8\" (UniqueName: \"kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8\") pod \"authorino-58cd955675-j9dk8\" (UID: \"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5\") " pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:27.795133 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.795108 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:34:27.797614 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.797599 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:34:27.805194 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.805172 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:34:27.870954 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.870922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9ddr\" (UniqueName: \"kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr\") pod \"authorino-75d556bd77-hjtjp\" (UID: \"0feec38f-3f38-4fb5-a588-66ae4fd78faf\") " pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:34:27.899859 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.899825 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:27.971864 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.971832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9ddr\" (UniqueName: \"kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr\") pod \"authorino-75d556bd77-hjtjp\" (UID: \"0feec38f-3f38-4fb5-a588-66ae4fd78faf\") " pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:34:27.982027 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:27.981918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9ddr\" (UniqueName: \"kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr\") pod \"authorino-75d556bd77-hjtjp\" (UID: \"0feec38f-3f38-4fb5-a588-66ae4fd78faf\") " pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:34:28.061953 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:28.061921 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:28.063089 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:34:28.063055 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58db5aa4_695a_4d3a_8523_8e2d0cb3d4f5.slice/crio-46af2c79ea83dd20502f8fbba22f5881b2202beb74ca8fd31908cb43fc7ade59 WatchSource:0}: Error finding container 46af2c79ea83dd20502f8fbba22f5881b2202beb74ca8fd31908cb43fc7ade59: Status 404 returned error can't find the container with id 46af2c79ea83dd20502f8fbba22f5881b2202beb74ca8fd31908cb43fc7ade59 Jun 11 19:34:28.108399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:28.108185 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:34:28.292618 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:28.292587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:34:28.294429 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:34:28.294398 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0feec38f_3f38_4fb5_a588_66ae4fd78faf.slice/crio-d846d0a7c9414094c91ba9bea8277f532b9d1734e79836f72a6c4bad5d62b3c3 WatchSource:0}: Error finding container d846d0a7c9414094c91ba9bea8277f532b9d1734e79836f72a6c4bad5d62b3c3: Status 404 returned error can't find the container with id d846d0a7c9414094c91ba9bea8277f532b9d1734e79836f72a6c4bad5d62b3c3 Jun 11 19:34:28.564002 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:28.563968 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9dk8" event={"ID":"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5","Type":"ContainerStarted","Data":"46af2c79ea83dd20502f8fbba22f5881b2202beb74ca8fd31908cb43fc7ade59"} Jun 11 19:34:28.565530 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:28.565491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hjtjp" event={"ID":"0feec38f-3f38-4fb5-a588-66ae4fd78faf","Type":"ContainerStarted","Data":"d846d0a7c9414094c91ba9bea8277f532b9d1734e79836f72a6c4bad5d62b3c3"} Jun 11 19:34:30.780228 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:30.780192 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:30.874770 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:30.874734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:32.601517 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.601480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" event={"ID":"42b114b0-ea9d-4b6d-bebe-dbfebd98b945","Type":"ContainerStarted","Data":"4bf1c30b29ae4c761ae5946d9d37d919de2401dc43c964597cb597feac670064"} Jun 11 19:34:32.602067 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.602040 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:32.603342 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.603313 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9dk8" event={"ID":"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5","Type":"ContainerStarted","Data":"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146"} Jun 11 19:34:32.605451 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.605426 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hjtjp" event={"ID":"0feec38f-3f38-4fb5-a588-66ae4fd78faf","Type":"ContainerStarted","Data":"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb"} Jun 11 19:34:32.622211 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.622163 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" podStartSLOduration=1.340299623 podStartE2EDuration="6.622144281s" totalImagesPullingTime="5.281844658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:32.621322197 +0000 UTC m=+703.337430163" watchObservedRunningTime="2026-06-11 19:34:32.622144281 +0000 UTC m=+703.338252248" Jun 11 19:34:32.640979 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.640932 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-j9dk8" podStartSLOduration=1.224708328 podStartE2EDuration="5.640917721s" totalImagesPullingTime="4.416209393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:32.638305795 +0000 UTC m=+703.354413772" watchObservedRunningTime="2026-06-11 19:34:32.640917721 +0000 UTC m=+703.357025687" Jun 11 19:34:32.659928 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.659844 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-hjtjp" podStartSLOduration=1.463249828 podStartE2EDuration="5.65982389s" totalImagesPullingTime="4.196574062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:32.656693282 +0000 UTC m=+703.372801248" watchObservedRunningTime="2026-06-11 19:34:32.65982389 +0000 UTC m=+703.375931856" Jun 11 19:34:32.686604 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:32.686572 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:33.241772 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:33.241737 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:33.341935 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:33.341897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:34.615474 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:34.615433 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-j9dk8" podUID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" containerName="authorino" containerID="cri-o://e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146" gracePeriod=30 Jun 11 19:34:34.863061 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:34.863038 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:34.943854 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:34.943814 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trdg8\" (UniqueName: \"kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8\") pod \"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5\" (UID: \"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5\") " Jun 11 19:34:34.946033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:34.946008 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8" (OuterVolumeSpecName: "kube-api-access-trdg8") pod "58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" (UID: "58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5"). InnerVolumeSpecName "kube-api-access-trdg8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:35.044998 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.044962 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trdg8\" (UniqueName: \"kubernetes.io/projected/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5-kube-api-access-trdg8\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:34:35.622139 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.622105 2562 generic.go:356] "Generic (PLEG): container finished" podID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" containerID="e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146" exitCode=0 Jun 11 19:34:35.622552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.622149 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-j9dk8" Jun 11 19:34:35.622552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.622191 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9dk8" event={"ID":"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5","Type":"ContainerDied","Data":"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146"} Jun 11 19:34:35.622552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.622235 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-j9dk8" event={"ID":"58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5","Type":"ContainerDied","Data":"46af2c79ea83dd20502f8fbba22f5881b2202beb74ca8fd31908cb43fc7ade59"} Jun 11 19:34:35.622552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.622254 2562 scope.go:117] "RemoveContainer" containerID="e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146" Jun 11 19:34:35.632334 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.632316 2562 scope.go:117] "RemoveContainer" containerID="e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146" Jun 11 19:34:35.632650 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:34:35.632628 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146\": container with ID starting with e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146 not found: ID does not exist" containerID="e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146" Jun 11 19:34:35.632724 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.632658 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146"} err="failed to get container status \"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146\": rpc error: code = NotFound desc = could not find container \"e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146\": container with ID starting with e6b546daa708063fa155e36bc33fde455cdb4fc3a8c249abb05ca8f2b7029146 not found: ID does not exist" Jun 11 19:34:35.644710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.644688 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:35.649082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.649062 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-j9dk8"] Jun 11 19:34:35.721387 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:35.721356 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" path="/var/lib/kubelet/pods/58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5/volumes" Jun 11 19:34:42.189390 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.189353 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:42.189953 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.189566 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" podUID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" containerName="limitador" containerID="cri-o://4bf1c30b29ae4c761ae5946d9d37d919de2401dc43c964597cb597feac670064" gracePeriod=30 Jun 11 19:34:42.190374 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.190239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:42.662769 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.662715 2562 generic.go:356] "Generic (PLEG): container finished" podID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" containerID="4bf1c30b29ae4c761ae5946d9d37d919de2401dc43c964597cb597feac670064" exitCode=0 Jun 11 19:34:42.662915 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.662745 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" event={"ID":"42b114b0-ea9d-4b6d-bebe-dbfebd98b945","Type":"ContainerDied","Data":"4bf1c30b29ae4c761ae5946d9d37d919de2401dc43c964597cb597feac670064"} Jun 11 19:34:42.752332 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.752260 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:42.914106 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.914078 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file\") pod \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " Jun 11 19:34:42.914265 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.914127 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv6cd\" (UniqueName: \"kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd\") pod \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\" (UID: \"42b114b0-ea9d-4b6d-bebe-dbfebd98b945\") " Jun 11 19:34:42.914533 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.914507 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file" (OuterVolumeSpecName: "config-file") pod "42b114b0-ea9d-4b6d-bebe-dbfebd98b945" (UID: "42b114b0-ea9d-4b6d-bebe-dbfebd98b945"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:34:42.916114 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:42.916094 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd" (OuterVolumeSpecName: "kube-api-access-wv6cd") pod "42b114b0-ea9d-4b6d-bebe-dbfebd98b945" (UID: "42b114b0-ea9d-4b6d-bebe-dbfebd98b945"). InnerVolumeSpecName "kube-api-access-wv6cd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:34:43.015385 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.015293 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv6cd\" (UniqueName: \"kubernetes.io/projected/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-kube-api-access-wv6cd\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:34:43.015385 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.015324 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/42b114b0-ea9d-4b6d-bebe-dbfebd98b945-config-file\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:34:43.670209 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.670177 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" Jun 11 19:34:43.670209 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.670193 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-5jnnh" event={"ID":"42b114b0-ea9d-4b6d-bebe-dbfebd98b945","Type":"ContainerDied","Data":"ef15e4033bcc96361cce2f9cb2d14416e1b3526d7dd771526921b4c9c9e88ed5"} Jun 11 19:34:43.670741 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.670258 2562 scope.go:117] "RemoveContainer" containerID="4bf1c30b29ae4c761ae5946d9d37d919de2401dc43c964597cb597feac670064" Jun 11 19:34:43.696103 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.696074 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:43.700165 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.700144 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-5jnnh"] Jun 11 19:34:43.722084 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:43.722058 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" path="/var/lib/kubelet/pods/42b114b0-ea9d-4b6d-bebe-dbfebd98b945/volumes" Jun 11 19:34:47.824552 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824520 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-hq9kf"] Jun 11 19:34:47.824916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824883 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" containerName="authorino" Jun 11 19:34:47.824916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824894 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" containerName="authorino" Jun 11 19:34:47.824916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824907 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" containerName="limitador" Jun 11 19:34:47.824916 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824912 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" containerName="limitador" Jun 11 19:34:47.825055 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824971 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="42b114b0-ea9d-4b6d-bebe-dbfebd98b945" containerName="limitador" Jun 11 19:34:47.825055 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.824982 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="58db5aa4-695a-4d3a-8523-8e2d0cb3d4f5" containerName="authorino" Jun 11 19:34:47.829280 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.829263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:47.834370 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.834348 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 19:34:47.840430 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.840406 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hq9kf"] Jun 11 19:34:47.887439 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.887398 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:47.957787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.957755 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfq2d\" (UniqueName: \"kubernetes.io/projected/188818d2-f5f0-40da-857b-ab36099c6daf-kube-api-access-kfq2d\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:47.957787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:47.957792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/188818d2-f5f0-40da-857b-ab36099c6daf-data\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.058750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.058705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfq2d\" (UniqueName: \"kubernetes.io/projected/188818d2-f5f0-40da-857b-ab36099c6daf-kube-api-access-kfq2d\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.058931 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.058758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/188818d2-f5f0-40da-857b-ab36099c6daf-data\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.059177 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.059159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/188818d2-f5f0-40da-857b-ab36099c6daf-data\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.068841 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.068813 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfq2d\" (UniqueName: \"kubernetes.io/projected/188818d2-f5f0-40da-857b-ab36099c6daf-kube-api-access-kfq2d\") pod \"postgres-69fb4594cf-hq9kf\" (UID: \"188818d2-f5f0-40da-857b-ab36099c6daf\") " pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.140739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.140662 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:48.276169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.276128 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-hq9kf"] Jun 11 19:34:48.279108 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:34:48.279073 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188818d2_f5f0_40da_857b_ab36099c6daf.slice/crio-d3820cd96d17ad16ccfc2feaf04b6680aca6cb93690c3f605e61a0494f7edce5 WatchSource:0}: Error finding container d3820cd96d17ad16ccfc2feaf04b6680aca6cb93690c3f605e61a0494f7edce5: Status 404 returned error can't find the container with id d3820cd96d17ad16ccfc2feaf04b6680aca6cb93690c3f605e61a0494f7edce5 Jun 11 19:34:48.697911 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:48.697873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hq9kf" event={"ID":"188818d2-f5f0-40da-857b-ab36099c6daf","Type":"ContainerStarted","Data":"d3820cd96d17ad16ccfc2feaf04b6680aca6cb93690c3f605e61a0494f7edce5"} Jun 11 19:34:51.049594 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:51.049572 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 11 19:34:51.721666 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:51.721627 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-hq9kf" event={"ID":"188818d2-f5f0-40da-857b-ab36099c6daf","Type":"ContainerStarted","Data":"d57ef01ad133206fd1ab07f1c711f2daac82bebc47c96e79c99903b6e274d076"} Jun 11 19:34:51.721843 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:51.721677 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:51.734542 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:51.734497 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-hq9kf" podStartSLOduration=1.968388911 podStartE2EDuration="4.734478139s" totalImagesPullingTime="2.766089228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:34:51.733960516 +0000 UTC m=+722.450068481" watchObservedRunningTime="2026-06-11 19:34:51.734478139 +0000 UTC m=+722.450586096" Jun 11 19:34:57.756750 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:57.756724 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-hq9kf" Jun 11 19:34:58.063063 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:58.062984 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:58.161872 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:58.161843 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:58.307244 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:58.307200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:34:59.424740 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.424703 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v"] Jun 11 19:34:59.428122 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.428105 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.431023 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.430998 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 11 19:34:59.431196 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.431171 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-rg4wv\"" Jun 11 19:34:59.432005 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.431987 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 11 19:34:59.441565 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.441537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v"] Jun 11 19:34:59.447828 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.447808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.447950 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.447850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.447950 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.447923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgghs\" (UniqueName: \"kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.549060 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.549033 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgghs\" (UniqueName: \"kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.549169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.549097 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.549169 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.549122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.549449 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.549430 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.549513 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.549437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.557872 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.557855 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgghs\" (UniqueName: \"kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs\") pod \"0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.738569 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.738498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:34:59.885447 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:34:59.885385 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v"] Jun 11 19:34:59.886787 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:34:59.886763 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb4fb91_3aab_4850_a5ad_618c3dea1d74.slice/crio-64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd WatchSource:0}: Error finding container 64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd: Status 404 returned error can't find the container with id 64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd Jun 11 19:35:00.764440 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:00.764406 2562 generic.go:356] "Generic (PLEG): container finished" podID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerID="21139c17549635fec1c3f682634cd26c97b524f162115d6aec6773ccbaedbfff" exitCode=0 Jun 11 19:35:00.764808 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:00.764493 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" event={"ID":"0eb4fb91-3aab-4850-a5ad-618c3dea1d74","Type":"ContainerDied","Data":"21139c17549635fec1c3f682634cd26c97b524f162115d6aec6773ccbaedbfff"} Jun 11 19:35:00.764808 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:00.764548 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" event={"ID":"0eb4fb91-3aab-4850-a5ad-618c3dea1d74","Type":"ContainerStarted","Data":"64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd"} Jun 11 19:35:02.777518 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:02.777421 2562 generic.go:356] "Generic (PLEG): container finished" podID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerID="4021853a93d0a334b28f9d839e422e0984990e03b55c2124b0ef8618d863cebe" exitCode=0 Jun 11 19:35:02.777864 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:02.777522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" event={"ID":"0eb4fb91-3aab-4850-a5ad-618c3dea1d74","Type":"ContainerDied","Data":"4021853a93d0a334b28f9d839e422e0984990e03b55c2124b0ef8618d863cebe"} Jun 11 19:35:03.785417 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:03.785383 2562 generic.go:356] "Generic (PLEG): container finished" podID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerID="18b3e5edd47d5bc1dcf832a007aa5999b792c45db5583f0c2466ea6a6b776481" exitCode=0 Jun 11 19:35:03.785876 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:03.785485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" event={"ID":"0eb4fb91-3aab-4850-a5ad-618c3dea1d74","Type":"ContainerDied","Data":"18b3e5edd47d5bc1dcf832a007aa5999b792c45db5583f0c2466ea6a6b776481"} Jun 11 19:35:04.920591 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.920562 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:35:04.995725 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.995694 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util\") pod \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " Jun 11 19:35:04.995933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.995750 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgghs\" (UniqueName: \"kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs\") pod \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " Jun 11 19:35:04.995933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.995786 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle\") pod \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\" (UID: \"0eb4fb91-3aab-4850-a5ad-618c3dea1d74\") " Jun 11 19:35:04.996317 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.996275 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle" (OuterVolumeSpecName: "bundle") pod "0eb4fb91-3aab-4850-a5ad-618c3dea1d74" (UID: "0eb4fb91-3aab-4850-a5ad-618c3dea1d74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:35:04.998089 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:04.998066 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs" (OuterVolumeSpecName: "kube-api-access-cgghs") pod "0eb4fb91-3aab-4850-a5ad-618c3dea1d74" (UID: "0eb4fb91-3aab-4850-a5ad-618c3dea1d74"). InnerVolumeSpecName "kube-api-access-cgghs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:35:05.001150 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.001125 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util" (OuterVolumeSpecName: "util") pod "0eb4fb91-3aab-4850-a5ad-618c3dea1d74" (UID: "0eb4fb91-3aab-4850-a5ad-618c3dea1d74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 19:35:05.096894 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.096787 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgghs\" (UniqueName: \"kubernetes.io/projected/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-kube-api-access-cgghs\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:35:05.096894 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.096827 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-bundle\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:35:05.096894 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.096841 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0eb4fb91-3aab-4850-a5ad-618c3dea1d74-util\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:35:05.798915 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.798881 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" event={"ID":"0eb4fb91-3aab-4850-a5ad-618c3dea1d74","Type":"ContainerDied","Data":"64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd"} Jun 11 19:35:05.799077 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.798933 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64b3f21c5e3f7f0b0ffeb8a1b65b329d57766c2a0da14d0ef6677432ec6cf2cd" Jun 11 19:35:05.799077 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:05.798894 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0228a3cc79630676fae641e6a38dab1752e85a08a4a9edc59ccf0da748gft2v" Jun 11 19:35:08.591378 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:08.591334 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:08.650369 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:08.650333 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:12.819773 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.819740 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8kwxf"] Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820085 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="pull" Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820097 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="pull" Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820116 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="extract" Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820122 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="extract" Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820135 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="util" Jun 11 19:35:12.820145 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820140 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="util" Jun 11 19:35:12.820346 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.820192 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eb4fb91-3aab-4850-a5ad-618c3dea1d74" containerName="extract" Jun 11 19:35:12.822393 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.822377 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" Jun 11 19:35:12.825678 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.825655 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 19:35:12.825678 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.825672 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 19:35:12.826570 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.826546 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-tvk29\"" Jun 11 19:35:12.833181 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.833159 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8kwxf"] Jun 11 19:35:12.860575 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.860547 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phx4t\" (UniqueName: \"kubernetes.io/projected/b062f223-e370-41db-b92f-264a5aaded99-kube-api-access-phx4t\") pod \"keycloak-operator-d67dbbb48-8kwxf\" (UID: \"b062f223-e370-41db-b92f-264a5aaded99\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" Jun 11 19:35:12.961873 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.961836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phx4t\" (UniqueName: \"kubernetes.io/projected/b062f223-e370-41db-b92f-264a5aaded99-kube-api-access-phx4t\") pod \"keycloak-operator-d67dbbb48-8kwxf\" (UID: \"b062f223-e370-41db-b92f-264a5aaded99\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" Jun 11 19:35:12.974986 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:12.974961 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phx4t\" (UniqueName: \"kubernetes.io/projected/b062f223-e370-41db-b92f-264a5aaded99-kube-api-access-phx4t\") pod \"keycloak-operator-d67dbbb48-8kwxf\" (UID: \"b062f223-e370-41db-b92f-264a5aaded99\") " pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" Jun 11 19:35:13.134311 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:13.134226 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" Jun 11 19:35:13.265380 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:13.265352 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-8kwxf"] Jun 11 19:35:13.266554 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:35:13.266526 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb062f223_e370_41db_b92f_264a5aaded99.slice/crio-18f0912d333d72aa533553825323c44323b71555ea552beaf8cafd6c9d33dbca WatchSource:0}: Error finding container 18f0912d333d72aa533553825323c44323b71555ea552beaf8cafd6c9d33dbca: Status 404 returned error can't find the container with id 18f0912d333d72aa533553825323c44323b71555ea552beaf8cafd6c9d33dbca Jun 11 19:35:13.850423 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:13.850385 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" event={"ID":"b062f223-e370-41db-b92f-264a5aaded99","Type":"ContainerStarted","Data":"18f0912d333d72aa533553825323c44323b71555ea552beaf8cafd6c9d33dbca"} Jun 11 19:35:19.890481 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:19.890433 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" event={"ID":"b062f223-e370-41db-b92f-264a5aaded99","Type":"ContainerStarted","Data":"f5fb7d22a1150bb47cd05cba821aed8b4199596e331f85cebb66f31f45cab11d"} Jun 11 19:35:19.914452 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:19.914394 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-8kwxf" podStartSLOduration=2.100155089 podStartE2EDuration="7.914380255s" totalImagesPullingTime="5.814225166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:19.913309631 +0000 UTC m=+750.629417608" watchObservedRunningTime="2026-06-11 19:35:19.914380255 +0000 UTC m=+750.630488219" Jun 11 19:35:28.163332 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:28.163290 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:28.217591 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:28.217555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:40.396799 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:40.396767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:57.726057 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:57.725978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:57.940621 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:57.940589 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hbp8w"] Jun 11 19:35:57.947941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:57.947924 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:57.954002 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:57.953972 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hbp8w"] Jun 11 19:35:58.066343 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.066278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcq9z\" (UniqueName: \"kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z\") pod \"authorino-5d4b67c446-hbp8w\" (UID: \"4be9529d-943b-4997-91ed-3ce6e39dee4a\") " pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:58.160472 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.160431 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hbp8w"] Jun 11 19:35:58.160701 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:35:58.160681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dcq9z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-hbp8w" podUID="4be9529d-943b-4997-91ed-3ce6e39dee4a" Jun 11 19:35:58.167024 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.166997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcq9z\" (UniqueName: \"kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z\") pod \"authorino-5d4b67c446-hbp8w\" (UID: \"4be9529d-943b-4997-91ed-3ce6e39dee4a\") " pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:58.182955 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.182923 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcq9z\" (UniqueName: \"kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z\") pod \"authorino-5d4b67c446-hbp8w\" (UID: \"4be9529d-943b-4997-91ed-3ce6e39dee4a\") " pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:58.187845 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.187823 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:35:58.190295 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.190276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:35:58.198522 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.198500 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:35:58.267751 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.267723 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qq2\" (UniqueName: \"kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2\") pod \"authorino-795898cb6-rgk4z\" (UID: \"bef3ea5c-8068-424d-818b-5acdae123672\") " pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:35:58.368578 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.368492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qq2\" (UniqueName: \"kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2\") pod \"authorino-795898cb6-rgk4z\" (UID: \"bef3ea5c-8068-424d-818b-5acdae123672\") " pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:35:58.369105 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.369083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:35:58.376794 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.376768 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qq2\" (UniqueName: \"kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2\") pod \"authorino-795898cb6-rgk4z\" (UID: \"bef3ea5c-8068-424d-818b-5acdae123672\") " pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:35:58.501323 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.501289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:35:58.630556 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:58.630533 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:35:58.631855 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:35:58.631828 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbef3ea5c_8068_424d_818b_5acdae123672.slice/crio-847e9a377a07caf981f130fe10873ef6bc1ca9752491e9ba0a1e8b406a4732dc WatchSource:0}: Error finding container 847e9a377a07caf981f130fe10873ef6bc1ca9752491e9ba0a1e8b406a4732dc: Status 404 returned error can't find the container with id 847e9a377a07caf981f130fe10873ef6bc1ca9752491e9ba0a1e8b406a4732dc Jun 11 19:35:59.101857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.101820 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795898cb6-rgk4z" event={"ID":"bef3ea5c-8068-424d-818b-5acdae123672","Type":"ContainerStarted","Data":"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d"} Jun 11 19:35:59.101857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.101862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795898cb6-rgk4z" event={"ID":"bef3ea5c-8068-424d-818b-5acdae123672","Type":"ContainerStarted","Data":"847e9a377a07caf981f130fe10873ef6bc1ca9752491e9ba0a1e8b406a4732dc"} Jun 11 19:35:59.102293 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.101877 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:59.107743 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.107723 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:35:59.118588 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.118551 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-795898cb6-rgk4z" podStartSLOduration=0.812372704 podStartE2EDuration="1.118538386s" totalImagesPullingTime="306.165682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:35:59.117575654 +0000 UTC m=+789.833683619" watchObservedRunningTime="2026-06-11 19:35:59.118538386 +0000 UTC m=+789.834646351" Jun 11 19:35:59.150362 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.150336 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:35:59.150548 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.150518 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-hjtjp" podUID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" containerName="authorino" containerID="cri-o://3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb" gracePeriod=30 Jun 11 19:35:59.175164 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.175137 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcq9z\" (UniqueName: \"kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z\") pod \"4be9529d-943b-4997-91ed-3ce6e39dee4a\" (UID: \"4be9529d-943b-4997-91ed-3ce6e39dee4a\") " Jun 11 19:35:59.177510 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.177486 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z" (OuterVolumeSpecName: "kube-api-access-dcq9z") pod "4be9529d-943b-4997-91ed-3ce6e39dee4a" (UID: "4be9529d-943b-4997-91ed-3ce6e39dee4a"). InnerVolumeSpecName "kube-api-access-dcq9z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:35:59.276856 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.276824 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcq9z\" (UniqueName: \"kubernetes.io/projected/4be9529d-943b-4997-91ed-3ce6e39dee4a-kube-api-access-dcq9z\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:35:59.290230 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.290193 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:35:59.292941 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.292921 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.295681 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.295661 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 19:35:59.304376 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.304352 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:35:59.378143 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.378116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.378259 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.378186 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56bzh\" (UniqueName: \"kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.407226 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.407205 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:35:59.478933 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.478870 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9ddr\" (UniqueName: \"kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr\") pod \"0feec38f-3f38-4fb5-a588-66ae4fd78faf\" (UID: \"0feec38f-3f38-4fb5-a588-66ae4fd78faf\") " Jun 11 19:35:59.479056 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.479028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.479097 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.479084 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56bzh\" (UniqueName: \"kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.481077 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.481048 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr" (OuterVolumeSpecName: "kube-api-access-w9ddr") pod "0feec38f-3f38-4fb5-a588-66ae4fd78faf" (UID: "0feec38f-3f38-4fb5-a588-66ae4fd78faf"). InnerVolumeSpecName "kube-api-access-w9ddr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:35:59.481609 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.481590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.487033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.487009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56bzh\" (UniqueName: \"kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh\") pod \"authorino-7ccdf689f4-dbkwh\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.580530 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.580456 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9ddr\" (UniqueName: \"kubernetes.io/projected/0feec38f-3f38-4fb5-a588-66ae4fd78faf-kube-api-access-w9ddr\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:35:59.605335 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.605298 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:35:59.746220 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:35:59.746184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:35:59.746924 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:35:59.746903 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5129690e_a521_42d2_9ac7_fcf281e39b9d.slice/crio-421e10676cf63e5d228b3f575e4061b8c213378af7ef8a8976649c88933f01a1 WatchSource:0}: Error finding container 421e10676cf63e5d228b3f575e4061b8c213378af7ef8a8976649c88933f01a1: Status 404 returned error can't find the container with id 421e10676cf63e5d228b3f575e4061b8c213378af7ef8a8976649c88933f01a1 Jun 11 19:36:00.109535 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.109510 2562 generic.go:356] "Generic (PLEG): container finished" podID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" containerID="3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb" exitCode=0 Jun 11 19:36:00.109857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.109550 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-hjtjp" Jun 11 19:36:00.109857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.109590 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hjtjp" event={"ID":"0feec38f-3f38-4fb5-a588-66ae4fd78faf","Type":"ContainerDied","Data":"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb"} Jun 11 19:36:00.109857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.109631 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-hjtjp" event={"ID":"0feec38f-3f38-4fb5-a588-66ae4fd78faf","Type":"ContainerDied","Data":"d846d0a7c9414094c91ba9bea8277f532b9d1734e79836f72a6c4bad5d62b3c3"} Jun 11 19:36:00.109857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.109652 2562 scope.go:117] "RemoveContainer" containerID="3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb" Jun 11 19:36:00.110807 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.110785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" event={"ID":"5129690e-a521-42d2-9ac7-fcf281e39b9d","Type":"ContainerStarted","Data":"421e10676cf63e5d228b3f575e4061b8c213378af7ef8a8976649c88933f01a1"} Jun 11 19:36:00.110907 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.110790 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hbp8w" Jun 11 19:36:00.124329 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.124308 2562 scope.go:117] "RemoveContainer" containerID="3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb" Jun 11 19:36:00.124667 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:36:00.124647 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb\": container with ID starting with 3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb not found: ID does not exist" containerID="3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb" Jun 11 19:36:00.124751 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.124674 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb"} err="failed to get container status \"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb\": rpc error: code = NotFound desc = could not find container \"3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb\": container with ID starting with 3eaecd1c33ab44c5b26d36d38d69da926c4361cbff16f4345943ccb64541eabb not found: ID does not exist" Jun 11 19:36:00.144082 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.144055 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hbp8w"] Jun 11 19:36:00.146696 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.146671 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hbp8w"] Jun 11 19:36:00.156113 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.156084 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:36:00.159157 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:00.159130 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-hjtjp"] Jun 11 19:36:01.118754 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.118719 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" event={"ID":"5129690e-a521-42d2-9ac7-fcf281e39b9d","Type":"ContainerStarted","Data":"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881"} Jun 11 19:36:01.135132 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.135089 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" podStartSLOduration=1.799674044 podStartE2EDuration="2.13507318s" totalImagesPullingTime="335.399136ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:36:01.132925336 +0000 UTC m=+791.849033300" watchObservedRunningTime="2026-06-11 19:36:01.13507318 +0000 UTC m=+791.851181141" Jun 11 19:36:01.162555 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.162525 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:36:01.162711 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.162689 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-795898cb6-rgk4z" podUID="bef3ea5c-8068-424d-818b-5acdae123672" containerName="authorino" containerID="cri-o://5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d" gracePeriod=30 Jun 11 19:36:01.403966 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.403942 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:36:01.497898 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.497871 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67qq2\" (UniqueName: \"kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2\") pod \"bef3ea5c-8068-424d-818b-5acdae123672\" (UID: \"bef3ea5c-8068-424d-818b-5acdae123672\") " Jun 11 19:36:01.500033 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.499992 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2" (OuterVolumeSpecName: "kube-api-access-67qq2") pod "bef3ea5c-8068-424d-818b-5acdae123672" (UID: "bef3ea5c-8068-424d-818b-5acdae123672"). InnerVolumeSpecName "kube-api-access-67qq2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:36:01.598842 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.598813 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67qq2\" (UniqueName: \"kubernetes.io/projected/bef3ea5c-8068-424d-818b-5acdae123672-kube-api-access-67qq2\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:36:01.721943 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.721913 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" path="/var/lib/kubelet/pods/0feec38f-3f38-4fb5-a588-66ae4fd78faf/volumes" Jun 11 19:36:01.722257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:01.722245 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4be9529d-943b-4997-91ed-3ce6e39dee4a" path="/var/lib/kubelet/pods/4be9529d-943b-4997-91ed-3ce6e39dee4a/volumes" Jun 11 19:36:02.125603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.125513 2562 generic.go:356] "Generic (PLEG): container finished" podID="bef3ea5c-8068-424d-818b-5acdae123672" containerID="5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d" exitCode=0 Jun 11 19:36:02.125603 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.125570 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-795898cb6-rgk4z" Jun 11 19:36:02.126094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.125598 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795898cb6-rgk4z" event={"ID":"bef3ea5c-8068-424d-818b-5acdae123672","Type":"ContainerDied","Data":"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d"} Jun 11 19:36:02.126094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.125646 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-795898cb6-rgk4z" event={"ID":"bef3ea5c-8068-424d-818b-5acdae123672","Type":"ContainerDied","Data":"847e9a377a07caf981f130fe10873ef6bc1ca9752491e9ba0a1e8b406a4732dc"} Jun 11 19:36:02.126094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.125668 2562 scope.go:117] "RemoveContainer" containerID="5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d" Jun 11 19:36:02.134894 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.134880 2562 scope.go:117] "RemoveContainer" containerID="5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d" Jun 11 19:36:02.135152 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:36:02.135133 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d\": container with ID starting with 5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d not found: ID does not exist" containerID="5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d" Jun 11 19:36:02.135196 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.135160 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d"} err="failed to get container status \"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d\": rpc error: code = NotFound desc = could not find container \"5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d\": container with ID starting with 5f5f2c6487d4b331a665b2d613e150fddfe362e6ccef214539bf47dc2748f08d not found: ID does not exist" Jun 11 19:36:02.144391 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.144369 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:36:02.147072 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.147051 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-795898cb6-rgk4z"] Jun 11 19:36:02.584907 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.584862 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:02.678299 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.678261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:02.758741 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:02.758653 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:03.721557 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:03.721529 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bef3ea5c-8068-424d-818b-5acdae123672" path="/var/lib/kubelet/pods/bef3ea5c-8068-424d-818b-5acdae123672/volumes" Jun 11 19:36:05.127367 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:05.127340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:05.223731 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:05.223701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:36.215892 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:36.215855 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:36.644841 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:36.644738 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:36.747754 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:36.747722 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:36.821072 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:36.821023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:36:42.589691 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:42.589640 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-p2sph container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 19:36:42.590086 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:42.589720 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podUID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 19:36:44.365399 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.365334 2562 generic.go:356] "Generic (PLEG): container finished" podID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerID="3febfbe5bbcbcaf1f11c6d0966cf9bbdcf3894d5eebbb418615821648a47ebd6" exitCode=0 Jun 11 19:36:44.365771 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.365408 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" event={"ID":"5ef82b20-cb11-4a33-834f-4052b67621e3","Type":"ContainerDied","Data":"3febfbe5bbcbcaf1f11c6d0966cf9bbdcf3894d5eebbb418615821648a47ebd6"} Jun 11 19:36:44.365814 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.365778 2562 scope.go:117] "RemoveContainer" containerID="3febfbe5bbcbcaf1f11c6d0966cf9bbdcf3894d5eebbb418615821648a47ebd6" Jun 11 19:36:44.366725 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.366700 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:36:44.366787 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.366766 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:36:44.366829 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:44.366801 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 11 19:36:45.372684 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:45.372645 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" event={"ID":"5ef82b20-cb11-4a33-834f-4052b67621e3","Type":"ContainerStarted","Data":"269a8bf714694faa98f77a86d2eb720a53c16842247f4ce062b89bb5843ba28e"} Jun 11 19:36:46.312251 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:46.312151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:36:46.312476 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:46.312428 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-p2sph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 11 19:36:46.312559 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:46.312500 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podUID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 11 19:36:47.312864 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:47.312815 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-p2sph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 11 19:36:47.313359 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:47.312893 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podUID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 11 19:36:48.312205 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:48.312163 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-p2sph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 11 19:36:48.312530 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:48.312498 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podUID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 11 19:36:49.312186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:49.312146 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-p2sph container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jun 11 19:36:49.312790 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:49.312757 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" podUID="5ef82b20-cb11-4a33-834f-4052b67621e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jun 11 19:36:50.315193 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:50.315167 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:36:50.315642 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:50.315622 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:36:50.316299 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:36:50.316283 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-p2sph" Jun 11 19:37:06.323107 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:06.323062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:45.249445 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:45.249378 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:45.302816 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:45.302777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:37:49.749496 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:49.749451 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:37:49.750908 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:49.750876 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:37:49.754278 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:49.754261 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:37:49.755730 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:37:49.755712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:39:27.614739 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.614703 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615085 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bef3ea5c-8068-424d-818b-5acdae123672" containerName="authorino" Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615097 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="bef3ea5c-8068-424d-818b-5acdae123672" containerName="authorino" Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615114 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" containerName="authorino" Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615119 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" containerName="authorino" Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615210 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="bef3ea5c-8068-424d-818b-5acdae123672" containerName="authorino" Jun 11 19:39:27.615263 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.615221 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0feec38f-3f38-4fb5-a588-66ae4fd78faf" containerName="authorino" Jun 11 19:39:27.618333 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.618314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.621824 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.621804 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 19:39:27.625139 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.625109 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:39:27.746642 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.746618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.746812 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.746647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndcqn\" (UniqueName: \"kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.746812 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.746666 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.847683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.847651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.847683 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.847686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndcqn\" (UniqueName: \"kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.847895 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.847709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.848381 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.848361 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.850238 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.850209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.855492 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.855450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndcqn\" (UniqueName: \"kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn\") pod \"authorino-56c5b898dd-gxc9q\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:27.929227 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:27.929205 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:39:28.063533 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:28.063498 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:39:28.064419 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:39:28.064392 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa49c2ea_11cb_48c1_ae00_1eeeda358759.slice/crio-7977563f64a5d19233e8b862b4da04d7f6427562c441eabdc3fa93101ac8d054 WatchSource:0}: Error finding container 7977563f64a5d19233e8b862b4da04d7f6427562c441eabdc3fa93101ac8d054: Status 404 returned error can't find the container with id 7977563f64a5d19233e8b862b4da04d7f6427562c441eabdc3fa93101ac8d054 Jun 11 19:39:28.065968 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:28.065947 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:39:28.265968 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:28.265897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" event={"ID":"aa49c2ea-11cb-48c1-ae00-1eeeda358759","Type":"ContainerStarted","Data":"7977563f64a5d19233e8b862b4da04d7f6427562c441eabdc3fa93101ac8d054"} Jun 11 19:39:29.272924 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.272888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" event={"ID":"aa49c2ea-11cb-48c1-ae00-1eeeda358759","Type":"ContainerStarted","Data":"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c"} Jun 11 19:39:29.289234 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.289183 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" podStartSLOduration=1.898500128 podStartE2EDuration="2.289170903s" totalImagesPullingTime="390.670775ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:39:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:39:29.287353055 +0000 UTC m=+1000.003461021" watchObservedRunningTime="2026-06-11 19:39:29.289170903 +0000 UTC m=+1000.005278868" Jun 11 19:39:29.316965 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.316933 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:39:29.317220 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.317186 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" podUID="5129690e-a521-42d2-9ac7-fcf281e39b9d" containerName="authorino" containerID="cri-o://ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881" gracePeriod=30 Jun 11 19:39:29.570208 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.570180 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:39:29.664068 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.664034 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert\") pod \"5129690e-a521-42d2-9ac7-fcf281e39b9d\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " Jun 11 19:39:29.664269 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.664118 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56bzh\" (UniqueName: \"kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh\") pod \"5129690e-a521-42d2-9ac7-fcf281e39b9d\" (UID: \"5129690e-a521-42d2-9ac7-fcf281e39b9d\") " Jun 11 19:39:29.666225 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.666201 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh" (OuterVolumeSpecName: "kube-api-access-56bzh") pod "5129690e-a521-42d2-9ac7-fcf281e39b9d" (UID: "5129690e-a521-42d2-9ac7-fcf281e39b9d"). InnerVolumeSpecName "kube-api-access-56bzh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:39:29.674728 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.674703 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5129690e-a521-42d2-9ac7-fcf281e39b9d" (UID: "5129690e-a521-42d2-9ac7-fcf281e39b9d"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:39:29.765320 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.765293 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5129690e-a521-42d2-9ac7-fcf281e39b9d-tls-cert\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:39:29.765320 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.765316 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56bzh\" (UniqueName: \"kubernetes.io/projected/5129690e-a521-42d2-9ac7-fcf281e39b9d-kube-api-access-56bzh\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:39:29.987315 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:29.987283 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:30.279168 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.279133 2562 generic.go:356] "Generic (PLEG): container finished" podID="5129690e-a521-42d2-9ac7-fcf281e39b9d" containerID="ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881" exitCode=0 Jun 11 19:39:30.279586 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.279174 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" Jun 11 19:39:30.279586 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.279219 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" event={"ID":"5129690e-a521-42d2-9ac7-fcf281e39b9d","Type":"ContainerDied","Data":"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881"} Jun 11 19:39:30.279586 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.279261 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7ccdf689f4-dbkwh" event={"ID":"5129690e-a521-42d2-9ac7-fcf281e39b9d","Type":"ContainerDied","Data":"421e10676cf63e5d228b3f575e4061b8c213378af7ef8a8976649c88933f01a1"} Jun 11 19:39:30.279586 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.279283 2562 scope.go:117] "RemoveContainer" containerID="ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881" Jun 11 19:39:30.288804 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.288786 2562 scope.go:117] "RemoveContainer" containerID="ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881" Jun 11 19:39:30.289064 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:39:30.289046 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881\": container with ID starting with ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881 not found: ID does not exist" containerID="ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881" Jun 11 19:39:30.289163 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.289072 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881"} err="failed to get container status \"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881\": rpc error: code = NotFound desc = could not find container \"ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881\": container with ID starting with ce5512478b182d9f01226aa2a1e4d9a59f055b478f2bab51ef8a2ad9f0f06881 not found: ID does not exist" Jun 11 19:39:30.295137 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.295116 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:39:30.299314 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:30.299294 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7ccdf689f4-dbkwh"] Jun 11 19:39:31.351108 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:31.351064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:31.722127 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:31.722096 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5129690e-a521-42d2-9ac7-fcf281e39b9d" path="/var/lib/kubelet/pods/5129690e-a521-42d2-9ac7-fcf281e39b9d/volumes" Jun 11 19:39:38.050354 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:38.050319 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:46.310380 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:46.310343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:46.513094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:46.513047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:39:46.613528 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:39:46.613407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:03.418740 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:40:03.418701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:09.011758 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:40:09.011721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:13.225358 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:40:13.225325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:13.327101 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:40:13.327061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:40:30.207775 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:40:30.207681 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:35.710247 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:35.710212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:49.158496 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.158448 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dd75d87b5-9czmh"] Jun 11 19:41:49.160149 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.158809 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5129690e-a521-42d2-9ac7-fcf281e39b9d" containerName="authorino" Jun 11 19:41:49.160149 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.158825 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5129690e-a521-42d2-9ac7-fcf281e39b9d" containerName="authorino" Jun 11 19:41:49.160149 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.158940 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5129690e-a521-42d2-9ac7-fcf281e39b9d" containerName="authorino" Jun 11 19:41:49.161287 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.161273 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.172484 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.172441 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd75d87b5-9czmh"] Jun 11 19:41:49.225280 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.225247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-tls-cert\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.225280 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.225287 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-oidc-ca\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.225492 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.225404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqf9\" (UniqueName: \"kubernetes.io/projected/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-kube-api-access-grqf9\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.326217 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.326181 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-tls-cert\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.326383 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.326225 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-oidc-ca\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.326383 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.326269 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqf9\" (UniqueName: \"kubernetes.io/projected/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-kube-api-access-grqf9\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.326943 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.326915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-oidc-ca\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.328757 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.328730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-tls-cert\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.334175 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.334152 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqf9\" (UniqueName: \"kubernetes.io/projected/abe20764-5a4a-4b19-9ef5-07f94e7eeb49-kube-api-access-grqf9\") pod \"authorino-5dd75d87b5-9czmh\" (UID: \"abe20764-5a4a-4b19-9ef5-07f94e7eeb49\") " pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.470582 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.470554 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dd75d87b5-9czmh" Jun 11 19:41:49.597407 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:49.597380 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dd75d87b5-9czmh"] Jun 11 19:41:49.598850 ip-10-0-140-225 kubenswrapper[2562]: W0611 19:41:49.598818 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabe20764_5a4a_4b19_9ef5_07f94e7eeb49.slice/crio-dedc83597678aa203cae20ff1c8546d414f773dbdd9d91b686cf167e2046c922 WatchSource:0}: Error finding container dedc83597678aa203cae20ff1c8546d414f773dbdd9d91b686cf167e2046c922: Status 404 returned error can't find the container with id dedc83597678aa203cae20ff1c8546d414f773dbdd9d91b686cf167e2046c922 Jun 11 19:41:50.036142 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:50.036109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd75d87b5-9czmh" event={"ID":"abe20764-5a4a-4b19-9ef5-07f94e7eeb49","Type":"ContainerStarted","Data":"dedc83597678aa203cae20ff1c8546d414f773dbdd9d91b686cf167e2046c922"} Jun 11 19:41:51.046616 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.046571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dd75d87b5-9czmh" event={"ID":"abe20764-5a4a-4b19-9ef5-07f94e7eeb49","Type":"ContainerStarted","Data":"7716820d4efaa4b3eb85a3a0c96137d709acf007096f4f26649b3bdc672bed25"} Jun 11 19:41:51.068701 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.068624 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dd75d87b5-9czmh" podStartSLOduration=1.626896892 podStartE2EDuration="2.068607587s" totalImagesPullingTime="441.710695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 19:41:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 19:41:51.066593033 +0000 UTC m=+1141.782700999" watchObservedRunningTime="2026-06-11 19:41:51.068607587 +0000 UTC m=+1141.784715615" Jun 11 19:41:51.099606 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.099569 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:41:51.099822 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.099795 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" podUID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" containerName="authorino" containerID="cri-o://0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c" gracePeriod=30 Jun 11 19:41:51.377013 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.376986 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:41:51.446935 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.446905 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndcqn\" (UniqueName: \"kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn\") pod \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " Jun 11 19:41:51.447094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.447003 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca\") pod \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " Jun 11 19:41:51.447094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.447038 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert\") pod \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\" (UID: \"aa49c2ea-11cb-48c1-ae00-1eeeda358759\") " Jun 11 19:41:51.449217 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.449179 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn" (OuterVolumeSpecName: "kube-api-access-ndcqn") pod "aa49c2ea-11cb-48c1-ae00-1eeeda358759" (UID: "aa49c2ea-11cb-48c1-ae00-1eeeda358759"). InnerVolumeSpecName "kube-api-access-ndcqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:41:51.452226 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.452194 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "aa49c2ea-11cb-48c1-ae00-1eeeda358759" (UID: "aa49c2ea-11cb-48c1-ae00-1eeeda358759"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 19:41:51.457573 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.457544 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "aa49c2ea-11cb-48c1-ae00-1eeeda358759" (UID: "aa49c2ea-11cb-48c1-ae00-1eeeda358759"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 19:41:51.548240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.548207 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndcqn\" (UniqueName: \"kubernetes.io/projected/aa49c2ea-11cb-48c1-ae00-1eeeda358759-kube-api-access-ndcqn\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:41:51.548240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.548231 2562 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/aa49c2ea-11cb-48c1-ae00-1eeeda358759-oidc-ca\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:41:51.548240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.548242 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/aa49c2ea-11cb-48c1-ae00-1eeeda358759-tls-cert\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:41:51.726257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.726226 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:51.825047 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:51.825018 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:52.053580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.053501 2562 generic.go:356] "Generic (PLEG): container finished" podID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" containerID="0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c" exitCode=0 Jun 11 19:41:52.053580 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.053543 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" Jun 11 19:41:52.054028 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.053589 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" event={"ID":"aa49c2ea-11cb-48c1-ae00-1eeeda358759","Type":"ContainerDied","Data":"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c"} Jun 11 19:41:52.054028 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.053623 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56c5b898dd-gxc9q" event={"ID":"aa49c2ea-11cb-48c1-ae00-1eeeda358759","Type":"ContainerDied","Data":"7977563f64a5d19233e8b862b4da04d7f6427562c441eabdc3fa93101ac8d054"} Jun 11 19:41:52.054028 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.053647 2562 scope.go:117] "RemoveContainer" containerID="0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c" Jun 11 19:41:52.062873 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.062858 2562 scope.go:117] "RemoveContainer" containerID="0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c" Jun 11 19:41:52.063113 ip-10-0-140-225 kubenswrapper[2562]: E0611 19:41:52.063096 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c\": container with ID starting with 0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c not found: ID does not exist" containerID="0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c" Jun 11 19:41:52.063167 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.063126 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c"} err="failed to get container status \"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c\": rpc error: code = NotFound desc = could not find container \"0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c\": container with ID starting with 0e6a28354278596a65f60ef7c133148d6890ac1775ec726a72187ecaac7b264c not found: ID does not exist" Jun 11 19:41:52.069950 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.069929 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:41:52.073507 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.073484 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56c5b898dd-gxc9q"] Jun 11 19:41:52.773119 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.773087 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:52.879292 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:52.879256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:41:53.722196 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:41:53.722162 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" path="/var/lib/kubelet/pods/aa49c2ea-11cb-48c1-ae00-1eeeda358759/volumes" Jun 11 19:42:49.791577 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:42:49.791545 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:42:49.793843 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:42:49.793820 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:42:49.797323 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:42:49.797301 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:42:49.799625 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:42:49.799602 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:43:18.629823 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:43:18.629793 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:19.729276 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:43:19.729246 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:49.164094 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:43:49.164060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:59.481910 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:43:59.481866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:43:59.581160 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:43:59.581126 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:07.927840 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:07.927805 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:13.852295 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:13.852262 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:13.915937 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:13.915904 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:46.041323 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:46.041271 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:47.340865 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:47.340832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:44:54.785901 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:44:54.785866 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:00.144186 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.144108 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-5z9hw"] Jun 11 19:45:00.144628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.144491 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" containerName="authorino" Jun 11 19:45:00.144628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.144507 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" containerName="authorino" Jun 11 19:45:00.144628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.144577 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa49c2ea-11cb-48c1-ae00-1eeeda358759" containerName="authorino" Jun 11 19:45:00.147426 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.147412 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:00.150851 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.150833 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sr96g\"" Jun 11 19:45:00.158736 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.158709 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-5z9hw"] Jun 11 19:45:00.239425 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.239398 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w2xs\" (UniqueName: \"kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs\") pod \"maas-api-key-cleanup-29686785-5z9hw\" (UID: \"2d19604e-3d8f-4dba-b0e2-75e507815db2\") " pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:00.339893 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.339868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w2xs\" (UniqueName: \"kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs\") pod \"maas-api-key-cleanup-29686785-5z9hw\" (UID: \"2d19604e-3d8f-4dba-b0e2-75e507815db2\") " pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:00.348154 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.348126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w2xs\" (UniqueName: \"kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs\") pod \"maas-api-key-cleanup-29686785-5z9hw\" (UID: \"2d19604e-3d8f-4dba-b0e2-75e507815db2\") " pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:00.458509 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.458486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:00.594413 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.594369 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686785-5z9hw"] Jun 11 19:45:00.596503 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:00.596455 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 19:45:01.106830 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:01.106791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" event={"ID":"2d19604e-3d8f-4dba-b0e2-75e507815db2","Type":"ContainerStarted","Data":"6080e22feaeb196c8ef055ead6d23051029e61d10e0dc8052782a052757838e0"} Jun 11 19:45:04.127710 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:04.127681 2562 generic.go:356] "Generic (PLEG): container finished" podID="2d19604e-3d8f-4dba-b0e2-75e507815db2" containerID="7393b026ae05b9794b3381b5167bcc799ae471c85d145eb2f5ef22c639a7774d" exitCode=0 Jun 11 19:45:04.128058 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:04.127771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" event={"ID":"2d19604e-3d8f-4dba-b0e2-75e507815db2","Type":"ContainerDied","Data":"7393b026ae05b9794b3381b5167bcc799ae471c85d145eb2f5ef22c639a7774d"} Jun 11 19:45:05.265174 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:05.265154 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:05.382373 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:05.382340 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w2xs\" (UniqueName: \"kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs\") pod \"2d19604e-3d8f-4dba-b0e2-75e507815db2\" (UID: \"2d19604e-3d8f-4dba-b0e2-75e507815db2\") " Jun 11 19:45:05.384987 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:05.384903 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs" (OuterVolumeSpecName: "kube-api-access-7w2xs") pod "2d19604e-3d8f-4dba-b0e2-75e507815db2" (UID: "2d19604e-3d8f-4dba-b0e2-75e507815db2"). InnerVolumeSpecName "kube-api-access-7w2xs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 19:45:05.483133 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:05.483106 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w2xs\" (UniqueName: \"kubernetes.io/projected/2d19604e-3d8f-4dba-b0e2-75e507815db2-kube-api-access-7w2xs\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 19:45:06.145656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:06.145571 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" Jun 11 19:45:06.145656 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:06.145609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686785-5z9hw" event={"ID":"2d19604e-3d8f-4dba-b0e2-75e507815db2","Type":"ContainerDied","Data":"6080e22feaeb196c8ef055ead6d23051029e61d10e0dc8052782a052757838e0"} Jun 11 19:45:06.145845 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:06.145694 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6080e22feaeb196c8ef055ead6d23051029e61d10e0dc8052782a052757838e0" Jun 11 19:45:09.954185 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:09.954139 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:15.568435 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:15.568400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:15.675947 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:15.675913 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:15.768799 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:15.768766 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:15.902984 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:15.902903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:16.002825 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:16.002793 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:32.583180 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:32.583145 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:32.657630 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:32.657589 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:32.759066 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:32.759036 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:39.392585 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:39.392543 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:39.494674 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:39.494639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:46.734257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:46.734222 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:46.836605 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:46.836572 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:46.936437 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:46.936407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:45:47.034063 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:45:47.033985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:03.444972 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:03.444939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:03.567627 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:03.567597 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:03.676693 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:03.676646 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:09.760046 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:09.760014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:09.829687 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:09.829657 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:25.988400 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:25.988366 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:26.091681 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:26.091652 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:26.250142 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:26.250047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:32.351905 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:32.351819 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:32.411335 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:32.411301 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:32.485533 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:32.485492 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:32.586597 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:32.586566 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:32.685240 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:32.685211 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:38.429447 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:38.429408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:46:38.492658 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:46:38.492613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:47:49.831132 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:47:49.831109 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:47:49.835953 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:47:49.835930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:47:49.836076 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:47:49.835985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:47:49.840766 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:47:49.840750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:48:08.555302 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:48:08.555205 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:48:08.608857 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:48:08.608813 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:48:13.144511 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:48:13.144445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:49:53.118446 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:49:53.118416 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:49:54.097865 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:49:54.097835 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:52:49.869064 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:52:49.868957 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:52:49.874109 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:52:49.873568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:52:49.875375 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:52:49.875357 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:52:49.880257 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:52:49.880241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:55:02.136001 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:55:02.135953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:55:21.901966 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:55:21.901922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:55:22.006131 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:55:22.006095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:57:49.906628 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:57:49.906507 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:57:49.911540 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:57:49.911504 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:57:49.914872 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:57:49.914855 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 19:57:49.919333 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:57:49.919316 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 19:59:43.604489 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:59:43.604445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 19:59:43.657446 ip-10-0-140-225 kubenswrapper[2562]: I0611 19:59:43.657422 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:00:00.133724 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.133649 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29686800-pmqlg"] Jun 11 20:00:00.134103 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.134005 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d19604e-3d8f-4dba-b0e2-75e507815db2" containerName="cleanup" Jun 11 20:00:00.134103 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.134016 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d19604e-3d8f-4dba-b0e2-75e507815db2" containerName="cleanup" Jun 11 20:00:00.134103 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.134089 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d19604e-3d8f-4dba-b0e2-75e507815db2" containerName="cleanup" Jun 11 20:00:00.137103 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.137086 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:00.139684 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.139662 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sr96g\"" Jun 11 20:00:00.152172 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.152146 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686800-pmqlg"] Jun 11 20:00:00.264119 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.264084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k2sk\" (UniqueName: \"kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk\") pod \"maas-api-key-cleanup-29686800-pmqlg\" (UID: \"0a2e1e79-3942-412d-a741-d04a2bbceedb\") " pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:00.364654 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.364624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k2sk\" (UniqueName: \"kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk\") pod \"maas-api-key-cleanup-29686800-pmqlg\" (UID: \"0a2e1e79-3942-412d-a741-d04a2bbceedb\") " pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:00.373017 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.372985 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k2sk\" (UniqueName: \"kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk\") pod \"maas-api-key-cleanup-29686800-pmqlg\" (UID: \"0a2e1e79-3942-412d-a741-d04a2bbceedb\") " pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:00.447619 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.447582 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:00.597713 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:00.597682 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29686800-pmqlg"] Jun 11 20:00:00.600049 ip-10-0-140-225 kubenswrapper[2562]: W0611 20:00:00.600020 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a2e1e79_3942_412d_a741_d04a2bbceedb.slice/crio-c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086 WatchSource:0}: Error finding container c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086: Status 404 returned error can't find the container with id c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086 Jun 11 20:00:01.014124 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:01.014090 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" event={"ID":"0a2e1e79-3942-412d-a741-d04a2bbceedb","Type":"ContainerStarted","Data":"f3486d054271807fe44deab99aeaf0b2e84eed03d0bb65854bebe93e7272c73f"} Jun 11 20:00:01.014293 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:01.014145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" event={"ID":"0a2e1e79-3942-412d-a741-d04a2bbceedb","Type":"ContainerStarted","Data":"c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086"} Jun 11 20:00:01.028603 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:01.028557 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" podStartSLOduration=1.028538493 podStartE2EDuration="1.028538493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:00:01.027914997 +0000 UTC m=+2231.744022970" watchObservedRunningTime="2026-06-11 20:00:01.028538493 +0000 UTC m=+2231.744646458" Jun 11 20:00:02.021451 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:02.021413 2562 generic.go:356] "Generic (PLEG): container finished" podID="0a2e1e79-3942-412d-a741-d04a2bbceedb" containerID="f3486d054271807fe44deab99aeaf0b2e84eed03d0bb65854bebe93e7272c73f" exitCode=0 Jun 11 20:00:02.021848 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:02.021507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" event={"ID":"0a2e1e79-3942-412d-a741-d04a2bbceedb","Type":"ContainerDied","Data":"f3486d054271807fe44deab99aeaf0b2e84eed03d0bb65854bebe93e7272c73f"} Jun 11 20:00:03.172642 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:03.172604 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:03.290441 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:03.290350 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7k2sk\" (UniqueName: \"kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk\") pod \"0a2e1e79-3942-412d-a741-d04a2bbceedb\" (UID: \"0a2e1e79-3942-412d-a741-d04a2bbceedb\") " Jun 11 20:00:03.292785 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:03.292757 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk" (OuterVolumeSpecName: "kube-api-access-7k2sk") pod "0a2e1e79-3942-412d-a741-d04a2bbceedb" (UID: "0a2e1e79-3942-412d-a741-d04a2bbceedb"). InnerVolumeSpecName "kube-api-access-7k2sk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 20:00:03.391188 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:03.391152 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7k2sk\" (UniqueName: \"kubernetes.io/projected/0a2e1e79-3942-412d-a741-d04a2bbceedb-kube-api-access-7k2sk\") on node \"ip-10-0-140-225.ec2.internal\" DevicePath \"\"" Jun 11 20:00:04.034973 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:04.034896 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" Jun 11 20:00:04.034973 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:04.034941 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29686800-pmqlg" event={"ID":"0a2e1e79-3942-412d-a741-d04a2bbceedb","Type":"ContainerDied","Data":"c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086"} Jun 11 20:00:04.035142 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:04.035018 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2a8d0cdb1c601811ab65e64b6f2f1648a6ce210df1332430bb1c648b60a2086" Jun 11 20:00:07.807110 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:07.807064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:00:30.270897 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:00:30.270861 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:02:49.945560 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:02:49.945531 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 20:02:49.950817 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:02:49.950798 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 20:02:49.954811 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:02:49.954791 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 20:02:49.959024 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:02:49.959003 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q99ll_45ab4f29-c98f-4841-a3fe-80f84c19ad6b/ovn-acl-logging/0.log" Jun 11 20:02:55.679064 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:02:55.679028 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:06.908880 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:06.908796 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:37.965476 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:37.965427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd75d87b5-9czmh_abe20764-5a4a-4b19-9ef5-07f94e7eeb49/authorino/0.log" Jun 11 20:03:42.329785 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:42.329759 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d9fb4b449-js7n7_ecc60ecf-c492-40e0-94e9-26e5dd410e29/nginx/0.log" Jun 11 20:03:42.756263 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:42.756236 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686785-5z9hw_2d19604e-3d8f-4dba-b0e2-75e507815db2/cleanup/0.log" Jun 11 20:03:42.858420 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:42.858389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686800-pmqlg_0a2e1e79-3942-412d-a741-d04a2bbceedb/cleanup/0.log" Jun 11 20:03:43.077570 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:43.077494 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cv45j_3a75dc8b-8df2-4c64-a285-bed6751b1a16/server/0.log" Jun 11 20:03:43.192208 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:43.192181 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-k2sqb_abedb934-2e20-47b7-ab82-1cdade0b3930/manager/0.log" Jun 11 20:03:43.544392 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:43.544367 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-c7b94_15e7ed90-cbf9-4e6c-b710-130864ebfa7b/copy-manifests/0.log" Jun 11 20:03:43.550383 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:43.550364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-c7b94_15e7ed90-cbf9-4e6c-b710-130864ebfa7b/manager/0.log" Jun 11 20:03:43.652418 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:43.652396 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hq9kf_188818d2-f5f0-40da-857b-ab36099c6daf/postgres/0.log" Jun 11 20:03:44.371787 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.371754 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/pull/0.log" Jun 11 20:03:44.376868 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.376823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/extract/0.log" Jun 11 20:03:44.381622 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.381605 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/util/0.log" Jun 11 20:03:44.489855 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.489832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/util/0.log" Jun 11 20:03:44.496733 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.496713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/pull/0.log" Jun 11 20:03:44.502176 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.502159 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/extract/0.log" Jun 11 20:03:44.607258 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.607229 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/util/0.log" Jun 11 20:03:44.612239 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.612220 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/pull/0.log" Jun 11 20:03:44.617403 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.617387 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/extract/0.log" Jun 11 20:03:44.715173 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.715145 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/util/0.log" Jun 11 20:03:44.720958 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.720937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/pull/0.log" Jun 11 20:03:44.726257 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.726238 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/extract/0.log" Jun 11 20:03:44.835942 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.835910 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd75d87b5-9czmh_abe20764-5a4a-4b19-9ef5-07f94e7eeb49/authorino/0.log" Jun 11 20:03:44.949774 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:44.949750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tdw94_193ecfe1-91d6-464c-951e-a9509c09ef20/manager/0.log" Jun 11 20:03:45.261978 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:45.261950 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mm6jk_b0732fe9-de74-49cf-9db1-3a5ed0b61888/registry-server/0.log" Jun 11 20:03:45.944736 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:45.944706 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959lgm2_49b5811c-f40f-44ae-988c-50d4a863937d/istio-proxy/0.log" Jun 11 20:03:46.364620 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:46.364544 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/1.log" Jun 11 20:03:46.689924 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:46.689902 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 20:03:51.017978 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.017944 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtt8t/must-gather-llqm4"] Jun 11 20:03:51.018341 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.018296 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a2e1e79-3942-412d-a741-d04a2bbceedb" containerName="cleanup" Jun 11 20:03:51.018341 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.018306 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a2e1e79-3942-412d-a741-d04a2bbceedb" containerName="cleanup" Jun 11 20:03:51.018416 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.018370 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a2e1e79-3942-412d-a741-d04a2bbceedb" containerName="cleanup" Jun 11 20:03:51.021594 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.021578 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.024208 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.024184 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtt8t\"/\"kube-root-ca.crt\"" Jun 11 20:03:51.024358 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.024235 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vtt8t\"/\"default-dockercfg-twl68\"" Jun 11 20:03:51.025222 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.025202 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vtt8t\"/\"openshift-service-ca.crt\"" Jun 11 20:03:51.043229 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.040231 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/must-gather-llqm4"] Jun 11 20:03:51.044828 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.044804 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:51.110662 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.110633 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tmq4\" (UniqueName: \"kubernetes.io/projected/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-kube-api-access-8tmq4\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.110786 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.110713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-must-gather-output\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.141124 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.141101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" limit=1024 Jun 11 20:03:51.211890 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.211850 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tmq4\" (UniqueName: \"kubernetes.io/projected/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-kube-api-access-8tmq4\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.212040 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.211963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-must-gather-output\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.212357 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.212339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-must-gather-output\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.220664 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.220637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tmq4\" (UniqueName: \"kubernetes.io/projected/647cf29c-e2ab-4aba-b3c8-57fd47eebe95-kube-api-access-8tmq4\") pod \"must-gather-llqm4\" (UID: \"647cf29c-e2ab-4aba-b3c8-57fd47eebe95\") " pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.331173 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.331090 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/must-gather-llqm4" Jun 11 20:03:51.465142 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.465115 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/must-gather-llqm4"] Jun 11 20:03:51.465874 ip-10-0-140-225 kubenswrapper[2562]: W0611 20:03:51.465852 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod647cf29c_e2ab_4aba_b3c8_57fd47eebe95.slice/crio-844771d0eb76f90c7771ceb6bc9febdf156587716bfe295f94f768a95a595976 WatchSource:0}: Error finding container 844771d0eb76f90c7771ceb6bc9febdf156587716bfe295f94f768a95a595976: Status 404 returned error can't find the container with id 844771d0eb76f90c7771ceb6bc9febdf156587716bfe295f94f768a95a595976 Jun 11 20:03:51.467837 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:51.467819 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 20:03:52.311186 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:52.310812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/must-gather-llqm4" event={"ID":"647cf29c-e2ab-4aba-b3c8-57fd47eebe95","Type":"ContainerStarted","Data":"ca1c66f74623c8bb175d438afba2fa34e59b7c72e6ec70f5c2a762d112500a16"} Jun 11 20:03:52.311186 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:52.310861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/must-gather-llqm4" event={"ID":"647cf29c-e2ab-4aba-b3c8-57fd47eebe95","Type":"ContainerStarted","Data":"844771d0eb76f90c7771ceb6bc9febdf156587716bfe295f94f768a95a595976"} Jun 11 20:03:53.319715 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:53.319676 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/must-gather-llqm4" event={"ID":"647cf29c-e2ab-4aba-b3c8-57fd47eebe95","Type":"ContainerStarted","Data":"f4acc9a6cb501d19ae5fa58129a4afca7e8f3ed35cf21cd32b00ca56162afc80"} Jun 11 20:03:53.343342 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:53.343275 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtt8t/must-gather-llqm4" podStartSLOduration=2.5989813550000003 podStartE2EDuration="3.343253178s" totalImagesPullingTime="744.271823ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 20:03:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:03:53.338134728 +0000 UTC m=+2464.054242694" watchObservedRunningTime="2026-06-11 20:03:53.343253178 +0000 UTC m=+2464.059361145" Jun 11 20:03:53.977412 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:53.977380 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nf6pg_d5bc9c87-26e2-4b39-becf-3d53b14a4977/global-pull-secret-syncer/0.log" Jun 11 20:03:54.063089 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:54.063046 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2x6j2_5f679210-6132-47f9-a853-9bf0db227eab/konnectivity-agent/0.log" Jun 11 20:03:54.187070 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:54.187036 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-225.ec2.internal_041ab909f1899d0af10f7e972f3a84b2/haproxy/0.log" Jun 11 20:03:59.375671 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.375603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/extract/0.log" Jun 11 20:03:59.405051 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.405009 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/util/0.log" Jun 11 20:03:59.428272 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.428147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759l8jx9_dbc1400a-8968-4be7-99e6-ff5d5b597140/pull/0.log" Jun 11 20:03:59.459966 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.459894 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/extract/0.log" Jun 11 20:03:59.482890 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.482864 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/util/0.log" Jun 11 20:03:59.504311 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.504250 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0c5phz_679bcdaa-a8ea-46cb-9295-9da49aa623b5/pull/0.log" Jun 11 20:03:59.544984 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.544928 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/extract/0.log" Jun 11 20:03:59.564615 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.564591 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/util/0.log" Jun 11 20:03:59.588610 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.588574 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73xsxtq_913c2381-1207-4d78-b49f-2e8050479fb9/pull/0.log" Jun 11 20:03:59.618184 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.618150 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/extract/0.log" Jun 11 20:03:59.640091 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.640014 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/util/0.log" Jun 11 20:03:59.660363 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.660339 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1r9pg5_a1248043-2548-40ce-b9c9-fedacea58353/pull/0.log" Jun 11 20:03:59.956514 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.956479 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5dd75d87b5-9czmh_abe20764-5a4a-4b19-9ef5-07f94e7eeb49/authorino/0.log" Jun 11 20:03:59.985378 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:03:59.985352 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-tdw94_193ecfe1-91d6-464c-951e-a9509c09ef20/manager/0.log" Jun 11 20:04:00.071110 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:00.071062 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mm6jk_b0732fe9-de74-49cf-9db1-3a5ed0b61888/registry-server/0.log" Jun 11 20:04:01.872716 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:01.872602 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-xjk42_47f2ddea-9e67-4a5c-8069-c79dc8fab9fe/monitoring-plugin/0.log" Jun 11 20:04:02.050909 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.050848 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/node-exporter/0.log" Jun 11 20:04:02.069414 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.069355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/kube-rbac-proxy/0.log" Jun 11 20:04:02.091091 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.090980 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-n4wz7_86895bd1-1da9-4f07-bd3f-f11a45806b90/init-textfile/0.log" Jun 11 20:04:02.388042 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.388001 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-cpcjn_a2156a1c-81ae-43b8-a378-dacc57bf18bc/prometheus-operator/0.log" Jun 11 20:04:02.404842 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.404815 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-cpcjn_a2156a1c-81ae-43b8-a378-dacc57bf18bc/kube-rbac-proxy/0.log" Jun 11 20:04:02.460390 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.460226 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56486db9dc-r7s47_ad1fad48-9e93-4f6a-a077-26c3e342bf81/telemeter-client/0.log" Jun 11 20:04:02.480520 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.480440 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56486db9dc-r7s47_ad1fad48-9e93-4f6a-a077-26c3e342bf81/reload/0.log" Jun 11 20:04:02.501808 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:02.501781 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-56486db9dc-r7s47_ad1fad48-9e93-4f6a-a077-26c3e342bf81/kube-rbac-proxy/0.log" Jun 11 20:04:04.562516 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:04.562483 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/1.log" Jun 11 20:04:04.570302 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:04.570280 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-p94gk_4159ac5a-c0b1-4fc6-9056-04df95039628/console-operator/2.log" Jun 11 20:04:05.351946 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.351906 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf"] Jun 11 20:04:05.357825 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.357799 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.365121 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.365085 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf"] Jun 11 20:04:05.458112 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.458078 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-podres\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.458295 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.458143 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-sys\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.458295 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.458181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r2v5\" (UniqueName: \"kubernetes.io/projected/d8786d09-3e5d-423f-98ea-9a588032ce77-kube-api-access-4r2v5\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.458295 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.458251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-lib-modules\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.458446 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.458300 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-proc\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559206 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-proc\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559377 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559283 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-podres\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559377 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-proc\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559377 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-sys\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559377 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559356 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r2v5\" (UniqueName: \"kubernetes.io/projected/d8786d09-3e5d-423f-98ea-9a588032ce77-kube-api-access-4r2v5\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559599 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-lib-modules\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559599 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559434 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-podres\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559599 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-sys\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.559599 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.559521 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d8786d09-3e5d-423f-98ea-9a588032ce77-lib-modules\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.573831 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.573795 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r2v5\" (UniqueName: \"kubernetes.io/projected/d8786d09-3e5d-423f-98ea-9a588032ce77-kube-api-access-4r2v5\") pod \"perf-node-gather-daemonset-sbhmf\" (UID: \"d8786d09-3e5d-423f-98ea-9a588032ce77\") " pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.670750 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.670409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:05.877207 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:05.877174 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf"] Jun 11 20:04:05.879440 ip-10-0-140-225 kubenswrapper[2562]: W0611 20:04:05.879393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd8786d09_3e5d_423f_98ea_9a588032ce77.slice/crio-cd345d919b6c8bf44f52c43f3b1effd7fc352a0f8c018a124bc89d006dce6a1a WatchSource:0}: Error finding container cd345d919b6c8bf44f52c43f3b1effd7fc352a0f8c018a124bc89d006dce6a1a: Status 404 returned error can't find the container with id cd345d919b6c8bf44f52c43f3b1effd7fc352a0f8c018a124bc89d006dce6a1a Jun 11 20:04:06.442534 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:06.442453 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" event={"ID":"d8786d09-3e5d-423f-98ea-9a588032ce77","Type":"ContainerStarted","Data":"7ebd389cb5cbe3688c85365006b935cac50561c3ef5b15adfaa4bcf97d8dc8dd"} Jun 11 20:04:06.442731 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:06.442568 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" event={"ID":"d8786d09-3e5d-423f-98ea-9a588032ce77","Type":"ContainerStarted","Data":"cd345d919b6c8bf44f52c43f3b1effd7fc352a0f8c018a124bc89d006dce6a1a"} Jun 11 20:04:06.443384 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:06.443356 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:06.464725 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:06.464669 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" podStartSLOduration=1.464633556 podStartE2EDuration="1.464633556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 20:04:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 20:04:06.46045584 +0000 UTC m=+2477.176563808" watchObservedRunningTime="2026-06-11 20:04:06.464633556 +0000 UTC m=+2477.180741521" Jun 11 20:04:07.308825 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:07.308802 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lcn49_7f70d60f-4248-443f-8697-31ba61c09839/dns/0.log" Jun 11 20:04:07.329724 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:07.329699 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lcn49_7f70d60f-4248-443f-8697-31ba61c09839/kube-rbac-proxy/0.log" Jun 11 20:04:07.351307 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:07.351278 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bqxnl_0fd362c8-b36a-406b-8b00-02ea92528c15/dns-node-resolver/0.log" Jun 11 20:04:07.949762 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:07.949643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-846cc7455f-2m2xx_cfa291a1-8a83-4926-9803-d12297178384/registry/0.log" Jun 11 20:04:07.962229 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:07.962184 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-846cc7455f-2m2xx_cfa291a1-8a83-4926-9803-d12297178384/registry/1.log" Jun 11 20:04:08.002656 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:08.002620 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rvbz5_317c1c25-d853-424a-834d-b3dd30727248/node-ca/0.log" Jun 11 20:04:08.940880 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:08.940847 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959lgm2_49b5811c-f40f-44ae-988c-50d4a863937d/istio-proxy/0.log" Jun 11 20:04:09.089599 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:09.089573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/0.log" Jun 11 20:04:09.126377 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:09.126347 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/1.log" Jun 11 20:04:09.233129 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:09.233043 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 20:04:09.918854 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:09.918826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fknsp_bfdc7592-516f-46c3-b1a2-6f48bf4dbba3/serve-healthcheck-canary/0.log" Jun 11 20:04:10.550251 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:10.550222 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-bv2mf_dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1/insights-operator/0.log" Jun 11 20:04:10.553068 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:10.553040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-bv2mf_dd765a5f-3f9b-4b9e-aa38-0b7c8ca03da1/insights-operator/1.log" Jun 11 20:04:10.780399 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:10.780364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxd6r_f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88/kube-rbac-proxy/0.log" Jun 11 20:04:10.805786 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:10.805710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxd6r_f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88/exporter/0.log" Jun 11 20:04:10.832252 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:10.832228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kxd6r_f2d481ff-ec8e-415f-a1a3-5e5ffadbbc88/extractor/0.log" Jun 11 20:04:13.245160 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.245133 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-5d9fb4b449-js7n7_ecc60ecf-c492-40e0-94e9-26e5dd410e29/nginx/0.log" Jun 11 20:04:13.438586 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.438559 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686785-5z9hw_2d19604e-3d8f-4dba-b0e2-75e507815db2/cleanup/0.log" Jun 11 20:04:13.467489 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.466170 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29686800-pmqlg_0a2e1e79-3942-412d-a741-d04a2bbceedb/cleanup/0.log" Jun 11 20:04:13.471816 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.471789 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vtt8t/perf-node-gather-daemonset-sbhmf" Jun 11 20:04:13.557559 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.557489 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-cv45j_3a75dc8b-8df2-4c64-a285-bed6751b1a16/server/0.log" Jun 11 20:04:13.617184 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.617153 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-k2sqb_abedb934-2e20-47b7-ab82-1cdade0b3930/manager/0.log" Jun 11 20:04:13.805827 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.805803 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-c7b94_15e7ed90-cbf9-4e6c-b710-130864ebfa7b/manager/0.log" Jun 11 20:04:13.829362 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.829296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-69cb86dcf5-c7b94_15e7ed90-cbf9-4e6c-b710-130864ebfa7b/copy-manifests/0.log" Jun 11 20:04:13.853905 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:13.853853 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-hq9kf_188818d2-f5f0-40da-857b-ab36099c6daf/postgres/0.log" Jun 11 20:04:15.516526 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:15.516491 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7b7c45796d-q4cn5_fe20a9dd-d5f5-4159-abc1-b15f0739cc1c/manager/0.log" Jun 11 20:04:18.999994 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:18.999943 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959lgm2_49b5811c-f40f-44ae-988c-50d4a863937d/istio-proxy/0.log" Jun 11 20:04:19.122276 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:19.122245 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/0.log" Jun 11 20:04:19.159602 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:19.159579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/1.log" Jun 11 20:04:19.237916 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:19.237889 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 20:04:20.402847 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:20.402809 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959lgm2_49b5811c-f40f-44ae-988c-50d4a863937d/istio-proxy/0.log" Jun 11 20:04:20.513733 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:20.513697 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/0.log" Jun 11 20:04:20.562130 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:20.562100 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/1.log" Jun 11 20:04:20.643329 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:20.643306 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 20:04:21.200736 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:21.200709 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-v6726_2daecc80-10bc-4c68-acc2-22da73cff479/migrator/0.log" Jun 11 20:04:21.225869 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:21.225841 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-v6726_2daecc80-10bc-4c68-acc2-22da73cff479/graceful-termination/0.log" Jun 11 20:04:21.638538 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:21.638440 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9xpb4_7335c92a-4a3b-4994-9682-5bfb2daacf1f/kube-storage-version-migrator-operator/1.log" Jun 11 20:04:21.639493 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:21.639452 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-9xpb4_7335c92a-4a3b-4994-9682-5bfb2daacf1f/kube-storage-version-migrator-operator/0.log" Jun 11 20:04:22.549978 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.549949 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97959lgm2_49b5811c-f40f-44ae-988c-50d4a863937d/istio-proxy/0.log" Jun 11 20:04:22.647346 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.647315 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/0.log" Jun 11 20:04:22.684191 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.684146 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-p2sph_5ef82b20-cb11-4a33-834f-4052b67621e3/istio-proxy/1.log" Jun 11 20:04:22.766593 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.766530 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54979cc4fb-q6kvt_2ff8f0d1-28e9-46e4-a593-9d1f3e482001/router/0.log" Jun 11 20:04:22.877231 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.877148 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/kube-multus-additional-cni-plugins/0.log" Jun 11 20:04:22.899843 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.899819 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/egress-router-binary-copy/0.log" Jun 11 20:04:22.921939 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.921916 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/cni-plugins/0.log" Jun 11 20:04:22.944019 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.943996 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/bond-cni-plugin/0.log" Jun 11 20:04:22.971479 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.971434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/routeoverride-cni/0.log" Jun 11 20:04:22.993564 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:22.993542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/whereabouts-cni-bincopy/0.log" Jun 11 20:04:23.016435 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:23.016409 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6xwzk_4298435a-2026-4105-8ece-f13f2c568c64/whereabouts-cni/0.log" Jun 11 20:04:23.396055 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:23.396023 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kqspm_95357c9a-ca54-44e6-85f5-049e1d925a1c/kube-multus/0.log" Jun 11 20:04:23.535230 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:23.535165 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z2kjx_0bf1a6fc-2154-4b49-8e85-5c4f248722d9/network-metrics-daemon/0.log" Jun 11 20:04:23.554845 ip-10-0-140-225 kubenswrapper[2562]: I0611 20:04:23.554821 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-z2kjx_0bf1a6fc-2154-4b49-8e85-5c4f248722d9/kube-rbac-proxy/0.log"