Jun 10 23:58:22.610767 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 10 23:58:22.610781 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 10 23:58:22.610791 ip-10-0-138-70 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 10 23:58:22.610985 ip-10-0-138-70 systemd[1]: Failed to start Kubernetes Kubelet. Jun 10 23:58:32.860018 ip-10-0-138-70 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 10 23:58:32.860041 ip-10-0-138-70 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 433c54b0066d406ba8f1070d6cc8ef7b -- Jun 11 00:01:08.849695 ip-10-0-138-70 systemd[1]: Starting Kubernetes Kubelet... Jun 11 00:01:09.261029 ip-10-0-138-70 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 00:01:09.261029 ip-10-0-138-70 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 00:01:09.261029 ip-10-0-138-70 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 00:01:09.261029 ip-10-0-138-70 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 00:01:09.261029 ip-10-0-138-70 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 00:01:09.262097 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.262012 2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 00:01:09.268857 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268841 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.268857 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268856 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268861 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268864 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268867 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268870 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268873 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268876 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268893 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268896 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268899 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268901 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268904 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268907 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268910 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268913 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268915 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268918 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268920 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268923 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.268927 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268926 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268929 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268931 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268934 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268938 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268940 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268944 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268946 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268949 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268951 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268954 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268956 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268959 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268961 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268964 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268968 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268972 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268977 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268980 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.269400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268983 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268987 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268992 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268995 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.268998 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269001 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269004 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269006 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269008 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269011 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269013 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269016 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269019 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269021 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269024 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269027 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269031 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269034 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269038 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269041 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.270145 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269044 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269046 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269049 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269052 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269055 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269057 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269060 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269062 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269065 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269067 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269070 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269073 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269075 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269078 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269081 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269092 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269095 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269098 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269101 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269104 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.270687 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269106 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269109 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269111 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269114 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269116 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269119 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269121 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269124 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269127 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269130 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269133 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269135 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269138 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269140 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269143 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269145 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269148 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269150 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269153 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.271200 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.269156 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.273195 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273179 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.273195 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273194 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273198 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273202 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273205 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273208 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273211 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273214 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273217 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273221 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273224 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273228 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273231 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273234 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273236 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273239 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273242 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273244 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273247 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273250 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.273264 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273252 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273263 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273266 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273269 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273272 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273275 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273278 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273281 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273284 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273287 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273289 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273293 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273296 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273299 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273301 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273304 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273307 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273309 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273312 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.273748 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273316 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273320 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273323 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273326 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273329 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273332 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273334 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273337 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273339 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273342 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273344 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273347 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273349 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273352 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273354 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273357 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273361 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273364 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273366 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273369 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.274193 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273372 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273374 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273377 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273381 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273383 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273387 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273391 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273394 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273396 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273399 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273402 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273404 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273407 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273409 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273412 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273415 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273436 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273439 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273442 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.274692 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273445 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273447 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273450 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273452 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273455 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273467 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273470 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273472 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273477 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273480 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273482 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273485 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273492 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273495 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273497 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273500 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273503 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273506 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273508 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273511 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.275151 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273513 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273917 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273923 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273926 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273929 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273932 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273935 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273938 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273941 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273944 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273947 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273950 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273952 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273955 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273957 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273960 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273963 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273972 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273975 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.275742 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273977 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273981 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273984 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273987 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273990 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273992 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273995 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.273997 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274000 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274003 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274005 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274008 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274011 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274013 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274016 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274019 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274021 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274024 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274026 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274030 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.276218 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274034 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274037 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274041 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274045 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274048 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274050 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274053 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274056 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274058 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274061 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274063 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274075 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274079 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274082 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274084 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274087 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274089 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274092 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274095 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.276718 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274097 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274100 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274104 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274106 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274109 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274112 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274114 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274117 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274120 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274122 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274125 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274128 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274130 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274133 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274135 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274138 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274140 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274143 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274145 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274148 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.277171 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274151 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274154 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274156 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274159 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274162 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274170 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274173 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274175 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274178 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274180 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274183 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274185 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274188 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274190 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274193 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274195 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274198 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274201 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274204 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274206 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.277673 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274209 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.274211 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274291 2558 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274307 2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274319 2558 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274323 2558 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274327 2558 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274330 2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274334 2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274338 2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274341 2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274344 2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274348 2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274352 2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274355 2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274357 2558 flags.go:64] FLAG: --cgroup-root="" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274360 2558 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274363 2558 flags.go:64] FLAG: --client-ca-file="" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274372 2558 flags.go:64] FLAG: --cloud-provider="external" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274376 2558 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274407 2558 flags.go:64] FLAG: --cluster-domain="" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274411 2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274414 2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274431 2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 00:01:09.278150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274435 2558 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274439 2558 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274442 2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274445 2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274448 2558 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274451 2558 flags.go:64] FLAG: --contention-profiling="false" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274454 2558 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274457 2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274460 2558 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274463 2558 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274467 2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274470 2558 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274473 2558 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274476 2558 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274479 2558 flags.go:64] FLAG: --enable-server="true" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274482 2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274489 2558 flags.go:64] FLAG: --event-burst="100" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274493 2558 flags.go:64] FLAG: --event-qps="50" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274496 2558 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274499 2558 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274502 2558 flags.go:64] FLAG: --eviction-hard="" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274507 2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274509 2558 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274512 2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274525 2558 flags.go:64] FLAG: --eviction-soft="" Jun 11 00:01:09.278743 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274530 2558 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274533 2558 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274543 2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274546 2558 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274549 2558 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274552 2558 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274555 2558 flags.go:64] FLAG: --feature-gates="" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274559 2558 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274562 2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274565 2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274568 2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274571 2558 flags.go:64] FLAG: --healthz-port="10248" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274575 2558 flags.go:64] FLAG: --help="false" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274578 2558 flags.go:64] FLAG: --hostname-override="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274581 2558 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274584 2558 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274587 2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274591 2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274594 2558 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274597 2558 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274600 2558 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274603 2558 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274606 2558 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 00:01:09.279340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274609 2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274612 2558 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274615 2558 flags.go:64] FLAG: --kube-reserved="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274618 2558 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274621 2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274624 2558 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274627 2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274630 2558 flags.go:64] FLAG: --lock-file="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274633 2558 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274636 2558 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274639 2558 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274644 2558 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274653 2558 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274656 2558 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274659 2558 flags.go:64] FLAG: --logging-format="text" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274662 2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274665 2558 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274667 2558 flags.go:64] FLAG: --manifest-url="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274670 2558 flags.go:64] FLAG: --manifest-url-header="" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274675 2558 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274678 2558 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274684 2558 flags.go:64] FLAG: --max-pods="110" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274687 2558 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274690 2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274694 2558 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 00:01:09.279965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274697 2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274700 2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274703 2558 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274706 2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274714 2558 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274717 2558 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274719 2558 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274722 2558 flags.go:64] FLAG: --pod-cidr="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274725 2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274731 2558 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274734 2558 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274737 2558 flags.go:64] FLAG: --pods-per-core="0" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274740 2558 flags.go:64] FLAG: --port="10250" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274743 2558 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274746 2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0225bd4618e188488" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274749 2558 flags.go:64] FLAG: --qos-reserved="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274752 2558 flags.go:64] FLAG: --read-only-port="10255" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274755 2558 flags.go:64] FLAG: --register-node="true" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274757 2558 flags.go:64] FLAG: --register-with-taints="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274761 2558 flags.go:64] FLAG: --registry-burst="10" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274770 2558 flags.go:64] FLAG: --registry-qps="5" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274773 2558 flags.go:64] FLAG: --reserved-cpus="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274776 2558 flags.go:64] FLAG: --reserved-memory="" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274779 2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274782 2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 00:01:09.280614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274785 2558 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274788 2558 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274791 2558 flags.go:64] FLAG: --runonce="false" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274794 2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274796 2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274799 2558 flags.go:64] FLAG: --seccomp-default="false" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274802 2558 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274805 2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274808 2558 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274810 2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274813 2558 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274816 2558 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274819 2558 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274822 2558 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274824 2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274827 2558 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274830 2558 flags.go:64] FLAG: --system-cgroups="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274833 2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274838 2558 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274844 2558 flags.go:64] FLAG: --tls-cert-file="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274848 2558 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274856 2558 flags.go:64] FLAG: --tls-min-version="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274859 2558 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274862 2558 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274864 2558 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 00:01:09.281218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274867 2558 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274870 2558 flags.go:64] FLAG: --v="2" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274874 2558 flags.go:64] FLAG: --version="false" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274884 2558 flags.go:64] FLAG: --vmodule="" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274888 2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.274891 2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275017 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275021 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275024 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275028 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275031 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275034 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275037 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275051 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275055 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275059 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275062 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275065 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275067 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275070 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.281880 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275073 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275076 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275079 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275081 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275084 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275087 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275091 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275094 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275096 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275099 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275101 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275104 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275108 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275111 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275114 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275117 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275130 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275133 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275135 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.282366 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275138 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275142 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275145 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275148 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275150 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275153 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275156 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275159 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275161 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275164 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275167 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275170 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275172 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275175 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275178 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275181 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275183 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275186 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275189 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275193 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.282837 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275196 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275199 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275201 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275204 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275206 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275209 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275212 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275214 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275217 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275220 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275223 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275226 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275228 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275233 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275235 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275238 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275240 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275243 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275246 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275248 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.283305 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275250 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275253 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275256 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275258 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275261 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275263 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275266 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275269 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275271 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275274 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275276 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275280 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275283 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275286 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275288 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275291 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275294 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275297 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275300 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275302 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.283801 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275305 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275308 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275310 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275314 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275316 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.275321 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.276046 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283028 2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283044 2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283062 2558 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283068 2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283124 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283129 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283133 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.284288 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283136 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283140 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283143 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283146 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283150 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283153 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283155 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283158 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283161 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283164 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283167 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283169 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283172 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283175 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283178 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283182 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283185 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283188 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283191 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283194 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.284656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283198 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283201 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283203 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283207 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283210 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283213 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283217 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283220 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283223 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283225 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283228 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283232 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283235 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283238 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283241 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283243 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283246 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283249 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283251 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283254 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.285143 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283256 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283259 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283261 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283264 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283267 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283269 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283272 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283274 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283277 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283279 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283282 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283284 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283287 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283290 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283292 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283295 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283298 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283301 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283303 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.285652 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283307 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283309 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283312 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283315 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283318 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283320 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283323 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283325 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283330 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283333 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283336 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283339 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283341 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283344 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283347 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283350 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283353 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283355 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283358 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283361 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.286118 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283363 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283366 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283368 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283371 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283373 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283376 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283379 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283382 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283384 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283387 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283389 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283392 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283395 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283398 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283400 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283403 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.286654 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283406 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283411 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283543 2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283547 2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283550 2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283552 2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283555 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283558 2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283560 2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283563 2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283566 2558 feature_gate.go:328] unrecognized feature gate: Example Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283569 2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283571 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283574 2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283576 2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 00:01:09.287074 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283579 2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283582 2558 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283584 2558 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283587 2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283589 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283592 2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283595 2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283597 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283600 2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283603 2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283606 2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283608 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283611 2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283614 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283616 2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283620 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283624 2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283627 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283631 2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 00:01:09.287451 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283633 2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283636 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283639 2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283642 2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283645 2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283648 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283651 2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283654 2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283656 2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283660 2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283663 2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283666 2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283668 2558 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283671 2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283674 2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283676 2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283679 2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283681 2558 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283684 2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283686 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 00:01:09.287918 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283690 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283692 2558 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283695 2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283697 2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283700 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283703 2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283706 2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283708 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283711 2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283714 2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283716 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283719 2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283722 2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283724 2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283727 2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283730 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283732 2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283735 2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283738 2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283740 2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 00:01:09.288395 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283743 2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283745 2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283748 2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283750 2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283753 2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283755 2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283758 2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283761 2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283763 2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283766 2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283768 2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283771 2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283776 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283779 2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283782 2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283784 2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283787 2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283790 2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283793 2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 00:01:09.288898 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283797 2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283800 2558 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283803 2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283807 2558 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283810 2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283813 2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283816 2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:09.283819 2558 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283824 2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.283929 2558 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.286061 2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.287605 2558 server.go:1019] "Starting client certificate rotation" Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.287706 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 00:01:09.289367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.287738 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 00:01:09.290543 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.290529 2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 00:01:09.291871 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.291856 2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 00:01:09.303631 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.303609 2558 log.go:25] "Validated CRI v1 runtime API" Jun 11 00:01:09.308194 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.308178 2558 log.go:25] "Validated CRI v1 image API" Jun 11 00:01:09.309079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.309061 2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 00:01:09.313219 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.313195 2558 fs.go:135] Filesystem UUIDs: map[05f6d5dd-4669-4566-8a0b-5b1711053bfa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c860589b-e253-42fc-98bd-d05745d07c2f:/dev/nvme0n1p3] Jun 11 00:01:09.313294 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.313217 2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 00:01:09.313913 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.313896 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 00:01:09.319690 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.319582 2558 manager.go:216] Machine: {Timestamp:2026-06-11 00:01:09.318184555 +0000 UTC m=+0.352561103 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098740 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2aa10c908039b516ab6aac112cfe9f SystemUUID:ec2aa10c-9080-39b5-16ab-6aac112cfe9f BootID:433c54b0-066d-406b-a8f1-070d6cc8ef7b Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:12:d5:ba:48:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:12:d5:ba:48:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:44:f4:23:b4:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 00:01:09.319690 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.319682 2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 00:01:09.319817 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.319760 2558 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 00:01:09.322344 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.322312 2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 00:01:09.322526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.322346 2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-70.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 00:01:09.323114 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.323101 2558 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 00:01:09.323167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.323119 2558 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 00:01:09.323167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.323130 2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 00:01:09.323793 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.323781 2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 00:01:09.324807 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.324795 2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 00:01:09.327859 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.327845 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 00:01:09.328001 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.327990 2558 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 00:01:09.328066 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328028 2558 kubelet.go:486] "Attempting to sync node with API server" Jun 11 00:01:09.328066 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328044 2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 00:01:09.328066 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328064 2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 00:01:09.328185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328083 2558 kubelet.go:398] "Adding apiserver pod source" Jun 11 00:01:09.328185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328096 2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 00:01:09.328486 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328473 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 00:01:09.328559 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.328495 2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 00:01:09.331094 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.331079 2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 00:01:09.333028 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333014 2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 00:01:09.333081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333045 2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 00:01:09.333483 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333468 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xhrv9" Jun 11 00:01:09.333774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333763 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333780 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333786 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333791 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333800 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333806 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333814 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333819 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 00:01:09.333823 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333825 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 00:01:09.334030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333838 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 00:01:09.334030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333851 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 00:01:09.334030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.333856 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 00:01:09.335293 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.335280 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 00:01:09.335293 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.335292 2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 00:01:09.337249 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.337231 2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-70.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 00:01:09.337310 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.337253 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-70.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 00:01:09.337480 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.337454 2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 00:01:09.338778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.338756 2558 server.go:1268] "Started kubelet" Jun 11 00:01:09.338977 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.338925 2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 00:01:09.339056 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.339010 2558 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 00:01:09.339245 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.339105 2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 00:01:09.339967 ip-10-0-138-70 systemd[1]: Started Kubernetes Kubelet. Jun 11 00:01:09.340506 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.339984 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xhrv9" Jun 11 00:01:09.340756 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.340737 2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 00:01:09.342130 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.342113 2558 server.go:310] "Adding debug handlers to kubelet server" Jun 11 00:01:09.347804 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.343622 2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-70.ec2.internal.18b7ddd175920f5a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-70.ec2.internal,UID:ip-10-0-138-70.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-70.ec2.internal,},FirstTimestamp:2026-06-11 00:01:09.33873033 +0000 UTC m=+0.373106874,LastTimestamp:2026-06-11 00:01:09.33873033 +0000 UTC m=+0.373106874,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-70.ec2.internal,}" Jun 11 00:01:09.348317 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.348299 2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 00:01:09.348401 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.348364 2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 00:01:09.348401 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.348383 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.348995 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.348956 2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 00:01:09.349090 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349006 2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 00:01:09.349090 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349006 2558 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 00:01:09.349090 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349030 2558 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 00:01:09.349240 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349108 2558 reconstruct.go:97] "Volume reconstruction finished" Jun 11 00:01:09.349240 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349118 2558 reconciler.go:29] "Reconciler: start to sync state" Jun 11 00:01:09.349365 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349349 2558 factory.go:55] Registering systemd factory Jun 11 00:01:09.349440 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349370 2558 factory.go:223] Registration of the systemd container factory successfully Jun 11 00:01:09.349602 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349588 2558 factory.go:153] Registering CRI-O factory Jun 11 00:01:09.349602 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349603 2558 factory.go:223] Registration of the crio container factory successfully Jun 11 00:01:09.349669 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349652 2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 00:01:09.349707 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349669 2558 factory.go:103] Registering Raw factory Jun 11 00:01:09.349707 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.349680 2558 manager.go:1196] Started watching for new ooms in manager Jun 11 00:01:09.350251 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.350235 2558 manager.go:349] Starting recovery of all containers Jun 11 00:01:09.359108 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.359086 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:09.359904 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.359768 2558 manager.go:354] Recovery completed Jun 11 00:01:09.361559 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.361539 2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-70.ec2.internal\" not found" node="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.363875 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.363864 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.365887 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.365871 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.365945 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.365898 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.365945 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.365909 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.366399 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.366382 2558 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 00:01:09.366399 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.366397 2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 00:01:09.366541 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.366415 2558 state_mem.go:36] "Initialized new in-memory state store" Jun 11 00:01:09.366541 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.366388 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.367142 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367126 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.367224 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367158 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.367224 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367172 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.367543 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367530 2558 policy_none.go:49] "None policy: Start" Jun 11 00:01:09.367588 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367546 2558 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 00:01:09.367588 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.367557 2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 00:01:09.368748 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.368737 2558 policy_none.go:47] "Start" Jun 11 00:01:09.414036 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414018 2558 manager.go:337] "Starting Device Plugin manager" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.414057 2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414071 2558 server.go:87] "Starting device plugin registration server" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414316 2558 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414329 2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414454 2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414532 2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.414541 2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.415038 2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.415083 2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.417171 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.418306 2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.418338 2558 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.418356 2558 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.418388 2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 00:01:09.420702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.420541 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:09.514484 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.514407 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.518405 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518389 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.518512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518440 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.518512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518448 2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal"] Jun 11 00:01:09.518512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518457 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.518512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518488 2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.518512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.518512 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.520122 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.520103 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.520212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.520134 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.520212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.520180 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.521558 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.521545 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.521689 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.521677 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.521731 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.521704 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.522287 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522262 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.522346 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522294 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.522346 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522306 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.522346 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522262 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.522449 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522363 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.522449 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.522375 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.523569 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.523553 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.523625 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.523580 2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 00:01:09.524239 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.524224 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientMemory" Jun 11 00:01:09.524304 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.524257 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 00:01:09.524304 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.524272 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeHasSufficientPID" Jun 11 00:01:09.524552 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.524540 2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.524595 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.524558 2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-70.ec2.internal\": node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.536965 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.536950 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.554074 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.554057 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-70.ec2.internal\" not found" node="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.558477 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.558460 2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-70.ec2.internal\" not found" node="ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.637226 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.637198 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.650551 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.650528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1e0b09ec255377f0d61fd9741eb78d3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"c1e0b09ec255377f0d61fd9741eb78d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.650629 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.650555 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.650629 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.650575 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.737712 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.737673 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.751024 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751002 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.751104 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751073 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.751157 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.751157 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751128 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1e0b09ec255377f0d61fd9741eb78d3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"c1e0b09ec255377f0d61fd9741eb78d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.751157 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751150 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f413e70b6b3053aef7174cee704a950c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal\" (UID: \"f413e70b6b3053aef7174cee704a950c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.751244 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.751162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c1e0b09ec255377f0d61fd9741eb78d3-config\") pod \"kube-apiserver-proxy-ip-10-0-138-70.ec2.internal\" (UID: \"c1e0b09ec255377f0d61fd9741eb78d3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.838516 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.838443 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:09.857825 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.857800 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.863486 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:09.863471 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:09.939571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:09.939540 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:10.040108 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:10.040085 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:10.140619 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:10.140552 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:10.241247 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:10.241213 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:10.286676 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.286648 2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 00:01:10.287189 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.286792 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 00:01:10.287189 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.286816 2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 00:01:10.341851 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:10.341824 2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-70.ec2.internal\" not found" Jun 11 00:01:10.347042 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.347015 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 23:56:09 +0000 UTC" deadline="2028-01-08 21:51:52.581078439 +0000 UTC" Jun 11 00:01:10.347042 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.347040 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13845h50m42.23404194s" Jun 11 00:01:10.373762 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.373739 2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:10.388672 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:10.388640 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf413e70b6b3053aef7174cee704a950c.slice/crio-f6b05cc3889262e51841219348f6766fbb7ac39fee91cd714e2362949f7d1e31 WatchSource:0}: Error finding container f6b05cc3889262e51841219348f6766fbb7ac39fee91cd714e2362949f7d1e31: Status 404 returned error can't find the container with id f6b05cc3889262e51841219348f6766fbb7ac39fee91cd714e2362949f7d1e31 Jun 11 00:01:10.388998 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:10.388978 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e0b09ec255377f0d61fd9741eb78d3.slice/crio-01357f208fd9871bd4c3f9700d97aadab4348282d77b1d39bfa779e6811f5590 WatchSource:0}: Error finding container 01357f208fd9871bd4c3f9700d97aadab4348282d77b1d39bfa779e6811f5590: Status 404 returned error can't find the container with id 01357f208fd9871bd4c3f9700d97aadab4348282d77b1d39bfa779e6811f5590 Jun 11 00:01:10.393538 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.393523 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 00:01:10.421162 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.421108 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" event={"ID":"c1e0b09ec255377f0d61fd9741eb78d3","Type":"ContainerStarted","Data":"01357f208fd9871bd4c3f9700d97aadab4348282d77b1d39bfa779e6811f5590"} Jun 11 00:01:10.422081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.422059 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"f413e70b6b3053aef7174cee704a950c","Type":"ContainerStarted","Data":"f6b05cc3889262e51841219348f6766fbb7ac39fee91cd714e2362949f7d1e31"} Jun 11 00:01:10.441722 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.441703 2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:10.448568 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.448550 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" Jun 11 00:01:10.457854 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.457837 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 00:01:10.458813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.458801 2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" Jun 11 00:01:10.467407 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:10.467393 2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 00:01:11.329201 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.329170 2558 apiserver.go:52] "Watching apiserver" Jun 11 00:01:11.338601 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.338571 2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 00:01:11.339711 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.339665 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-fmcjg","openshift-ovn-kubernetes/ovnkube-node-rw7tr","kube-system/global-pull-secret-syncer-rvrbw","kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k","openshift-cluster-node-tuning-operator/tuned-wrhc6","openshift-image-registry/node-ca-w69dp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal","openshift-multus/network-metrics-daemon-28x5s","openshift-network-diagnostics/network-check-target-7wmmj","kube-system/konnectivity-agent-82tcd","openshift-dns/node-resolver-5xr57","openshift-multus/multus-9hclj","openshift-multus/multus-additional-cni-plugins-mzqrh"] Jun 11 00:01:11.341853 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.341823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:11.341980 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.341910 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:11.343285 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.343263 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.344450 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.344416 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.344545 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.344505 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:11.345954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.345675 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.345954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.345744 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 00:01:11.345954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.345768 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-btldt\"" Jun 11 00:01:11.346144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.345978 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.346144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.346097 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 00:01:11.346144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.346120 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.346912 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.346895 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.348086 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348049 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 00:01:11.348191 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348163 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 00:01:11.348367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348349 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7pjsd\"" Jun 11 00:01:11.348493 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348457 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.348908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348889 2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 00:01:11.349010 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.348952 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 00:01:11.349184 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.349164 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.349291 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.349232 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.349481 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.349464 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-d9wrm\"" Jun 11 00:01:11.349843 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.349821 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.349937 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.349886 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:11.350715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.350566 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.350715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.350611 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-kbzsd\"" Jun 11 00:01:11.350715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.350670 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.351179 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.351131 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.353014 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.352993 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.353490 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.353373 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 00:01:11.353490 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.353440 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.353642 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.353573 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.353750 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.353714 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9ns7q\"" Jun 11 00:01:11.354614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.354598 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.355091 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.355071 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 00:01:11.355367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.355349 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 00:01:11.355668 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.355647 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.356202 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.356183 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.356497 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.356478 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 00:01:11.356597 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.356481 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 00:01:11.356663 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.356596 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dv7xw\"" Jun 11 00:01:11.356755 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.356683 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.357027 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.357009 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.357508 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.357491 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.357599 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.357521 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tfp4k\"" Jun 11 00:01:11.357671 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.357495 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 00:01:11.357730 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.357715 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.358784 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.358765 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n5kcr\"" Jun 11 00:01:11.358979 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.358956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-os-release\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.358995 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359146 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359046 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysconfig\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359146 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359071 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-systemd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359146 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359095 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58vr6\" (UniqueName: \"kubernetes.io/projected/a96e0628-ae65-4495-a644-1d920aae686d-kube-api-access-58vr6\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.359146 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359135 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-os-release\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359333 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-netns\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359333 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359207 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359333 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-conf\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359333 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359262 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-host\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359333 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-conf-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359340 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-multus-certs\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359403 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359434 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-lib-modules\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359460 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359490 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-kubelet-config\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359526 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-dbus\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.359579 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359581 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359581 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359668 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-tuned\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359691 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvxxd\" (UniqueName: \"kubernetes.io/projected/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-kube-api-access-pvxxd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359707 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-system-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359729 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-cnibin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359755 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-cni-binary-copy\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359778 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-system-cni-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359786 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359801 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-cnibin\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359819 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-modprobe-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359852 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359866 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-sys\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-var-lib-kubelet\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359906 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-socket-dir-parent\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359922 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-bin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.359995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359971 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-kubernetes\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.359997 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-tmp\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-multus\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-kubelet\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360091 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc6ld\" (UniqueName: \"kubernetes.io/projected/c60908e2-edf4-4e65-88c5-99895dae5946-kube-api-access-cc6ld\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360115 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-device-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-run\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360186 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360212 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-k8s-cni-cncf-io\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360236 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-multus-daemon-config\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-socket-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360288 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-registration-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360334 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lkkc8\"" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360348 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360337 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlsfp\" (UniqueName: \"kubernetes.io/projected/34d6d91e-5c3f-4076-a279-5a929d23603c-kube-api-access-qlsfp\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360382 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360393 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srxnp\" (UniqueName: \"kubernetes.io/projected/03afd107-494a-41a2-bfcb-cab57d031808-kube-api-access-srxnp\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.360929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360415 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-hostroot\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.361774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360449 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-etc-kubernetes\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.361774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.360470 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-sys-fs\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.361774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.361288 2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 00:01:11.379493 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.379472 2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnn7d" Jun 11 00:01:11.384292 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.384273 2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vnn7d" Jun 11 00:01:11.450597 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.450567 2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 00:01:11.461467 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461434 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-systemd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.461609 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461481 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-os-release\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.461609 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461506 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-systemd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.461609 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461511 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.461609 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461592 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-os-release\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461614 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-conf\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461636 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-multus-certs\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461670 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461681 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461694 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6h89\" (UniqueName: \"kubernetes.io/projected/c8df0dcc-e346-46ed-ac90-89794ce063c4-kube-api-access-n6h89\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461720 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-multus-certs\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461723 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-conf\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.461822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461800 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-systemd-units\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461919 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-netns\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461956 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-host-slash\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.461987 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-dbus\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462018 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462044 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-socket-dir-parent\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462067 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-bin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-dbus\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-cnibin\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462115 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462134 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-socket-dir-parent\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462137 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-var-lib-kubelet\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.462214 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462185 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-var-lib-kubelet\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462231 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-kubelet\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-bin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462308 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-cnibin\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462452 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysctl-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462185 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-kubelet\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462493 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc6ld\" (UniqueName: \"kubernetes.io/projected/c60908e2-edf4-4e65-88c5-99895dae5946-kube-api-access-cc6ld\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-device-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462539 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.462567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462564 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-node-log\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462593 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-device-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462655 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-multus\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462673 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-etc-selinux\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462678 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-ovn\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.462710 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462721 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-config\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462729 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-var-lib-cni-multus\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462739 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462746 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5028d8be-d56a-4c7a-a01e-17f5579913e4-hosts-file\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.462802 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:11.962768387 +0000 UTC m=+2.997144939 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-k8s-cni-cncf-io\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-bin\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462888 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovn-node-metrics-cert\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.462894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462897 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-k8s-cni-cncf-io\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462911 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8df0dcc-e346-46ed-ac90-89794ce063c4-serviceca\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462940 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-etc-kubernetes\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462964 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.462986 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfg4q\" (UniqueName: \"kubernetes.io/projected/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-kube-api-access-rfg4q\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-iptables-alerter-script\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463013 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-etc-kubernetes\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysconfig\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463090 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58vr6\" (UniqueName: \"kubernetes.io/projected/a96e0628-ae65-4495-a644-1d920aae686d-kube-api-access-58vr6\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-netns\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463121 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-sysconfig\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-slash\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463162 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-systemd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463186 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-host\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463205 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-host-run-netns\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-conf-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.463575 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463258 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8df0dcc-e346-46ed-ac90-89794ce063c4-host\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463281 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-lib-modules\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463279 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-conf-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463324 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-host\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463331 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463317 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463369 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-multus-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463384 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-kubelet\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463402 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-script-lib\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463439 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-kubelet-config\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463443 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-lib-modules\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463459 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-tuned\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463487 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvxxd\" (UniqueName: \"kubernetes.io/projected/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-kube-api-access-pvxxd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463510 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-system-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463523 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/84ff857a-d5d2-41b3-9876-5106e2f822bf-kubelet-config\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463533 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-cnibin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463579 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-cni-binary-copy\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-multus-daemon-config\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.464286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463769 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-registration-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463802 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-system-cni-dir\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463815 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-system-cni-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463845 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-modprobe-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-sys\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463897 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-sys-fs\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463897 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-cnibin\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463928 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-etc-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-sys\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463950 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-registration-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463953 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-env-overrides\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.463975 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-modprobe-d\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464007 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a14161ea-8dbd-4030-bb1a-64387354a2d4-agent-certs\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464029 2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464066 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a14161ea-8dbd-4030-bb1a-64387354a2d4-konnectivity-ca\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464098 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-kubernetes\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464032 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-sys-fs\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464125 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-tmp\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464142 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-cni-binary-copy\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464151 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlsfp\" (UniqueName: \"kubernetes.io/projected/34d6d91e-5c3f-4076-a279-5a929d23603c-kube-api-access-qlsfp\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464186 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c60908e2-edf4-4e65-88c5-99895dae5946-multus-daemon-config\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464190 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-netd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464201 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-kubernetes\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464223 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-system-cni-dir\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464233 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5028d8be-d56a-4c7a-a01e-17f5579913e4-tmp-dir\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464263 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-run\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464348 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-run\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-socket-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464408 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464451 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhnf\" (UniqueName: \"kubernetes.io/projected/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-kube-api-access-nlhnf\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srxnp\" (UniqueName: \"kubernetes.io/projected/03afd107-494a-41a2-bfcb-cab57d031808-kube-api-access-srxnp\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.464482 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464517 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-hostroot\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/34d6d91e-5c3f-4076-a279-5a929d23603c-socket-dir\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.465777 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.464539 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:11.964521937 +0000 UTC m=+2.998898501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464490 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c60908e2-edf4-4e65-88c5-99895dae5946-hostroot\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464576 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-var-lib-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464598 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-log-socket\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464617 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p9sv\" (UniqueName: \"kubernetes.io/projected/5028d8be-d56a-4c7a-a01e-17f5579913e4-kube-api-access-8p9sv\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464638 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-os-release\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464659 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464682 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.464746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03afd107-494a-41a2-bfcb-cab57d031808-os-release\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.465162 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.466526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.465262 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03afd107-494a-41a2-bfcb-cab57d031808-cni-binary-copy\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.467535 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.467514 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-tmp\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.467653 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.467579 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-etc-tuned\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.470099 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.470077 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:11.470099 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.470102 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:11.470247 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.470114 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:11.470247 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.470167 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:11.970150408 +0000 UTC m=+3.004526950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:11.475768 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.475733 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc6ld\" (UniqueName: \"kubernetes.io/projected/c60908e2-edf4-4e65-88c5-99895dae5946-kube-api-access-cc6ld\") pod \"multus-9hclj\" (UID: \"c60908e2-edf4-4e65-88c5-99895dae5946\") " pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.480361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.478602 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srxnp\" (UniqueName: \"kubernetes.io/projected/03afd107-494a-41a2-bfcb-cab57d031808-kube-api-access-srxnp\") pod \"multus-additional-cni-plugins-mzqrh\" (UID: \"03afd107-494a-41a2-bfcb-cab57d031808\") " pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.480361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.479732 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlsfp\" (UniqueName: \"kubernetes.io/projected/34d6d91e-5c3f-4076-a279-5a929d23603c-kube-api-access-qlsfp\") pod \"aws-ebs-csi-driver-node-8d42k\" (UID: \"34d6d91e-5c3f-4076-a279-5a929d23603c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.480361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.480095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvxxd\" (UniqueName: \"kubernetes.io/projected/1579d680-56e3-464c-8c0b-4b5bcfff9a6a-kube-api-access-pvxxd\") pod \"tuned-wrhc6\" (UID: \"1579d680-56e3-464c-8c0b-4b5bcfff9a6a\") " pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.481597 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.481574 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58vr6\" (UniqueName: \"kubernetes.io/projected/a96e0628-ae65-4495-a644-1d920aae686d-kube-api-access-58vr6\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.486671 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.486648 2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:11.565248 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565221 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-kubelet\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565248 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-script-lib\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-etc-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565309 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-env-overrides\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565329 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a14161ea-8dbd-4030-bb1a-64387354a2d4-agent-certs\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565336 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-kubelet\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a14161ea-8dbd-4030-bb1a-64387354a2d4-konnectivity-ca\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565385 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-etc-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565400 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-netd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565455 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-netd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565461 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5028d8be-d56a-4c7a-a01e-17f5579913e4-tmp-dir\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.565511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565513 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565542 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhnf\" (UniqueName: \"kubernetes.io/projected/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-kube-api-access-nlhnf\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565571 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-var-lib-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565595 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-log-socket\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565619 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p9sv\" (UniqueName: \"kubernetes.io/projected/5028d8be-d56a-4c7a-a01e-17f5579913e4-kube-api-access-8p9sv\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565674 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6h89\" (UniqueName: \"kubernetes.io/projected/c8df0dcc-e346-46ed-ac90-89794ce063c4-kube-api-access-n6h89\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-systemd-units\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565713 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-var-lib-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565733 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-netns\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565767 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-host-slash\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5028d8be-d56a-4c7a-a01e-17f5579913e4-tmp-dir\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565772 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-netns\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565812 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-node-log\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565821 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-log-socket\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-ovn\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565860 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-env-overrides\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565860 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-node-log\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565901 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-host-slash\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-ovn\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565937 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a14161ea-8dbd-4030-bb1a-64387354a2d4-konnectivity-ca\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565944 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-script-lib\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.565957 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-openvswitch\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-config\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566045 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-systemd-units\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566074 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5028d8be-d56a-4c7a-a01e-17f5579913e4-hosts-file\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566174 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-bin\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566184 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/5028d8be-d56a-4c7a-a01e-17f5579913e4-hosts-file\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovn-node-metrics-cert\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8df0dcc-e346-46ed-ac90-89794ce063c4-serviceca\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566238 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-cni-bin\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566254 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566272 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfg4q\" (UniqueName: \"kubernetes.io/projected/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-kube-api-access-rfg4q\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566290 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-iptables-alerter-script\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.566732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566306 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-slash\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566324 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-systemd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566346 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8df0dcc-e346-46ed-ac90-89794ce063c4-host\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566394 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c8df0dcc-e346-46ed-ac90-89794ce063c4-host\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566535 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovnkube-config\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-slash\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566609 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-host-run-ovn-kubernetes\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566634 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-run-systemd\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566735 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c8df0dcc-e346-46ed-ac90-89794ce063c4-serviceca\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.567605 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.566993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-iptables-alerter-script\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.568112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.568015 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a14161ea-8dbd-4030-bb1a-64387354a2d4-agent-certs\") pod \"konnectivity-agent-82tcd\" (UID: \"a14161ea-8dbd-4030-bb1a-64387354a2d4\") " pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.568592 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.568562 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-ovn-node-metrics-cert\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.574000 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.573970 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p9sv\" (UniqueName: \"kubernetes.io/projected/5028d8be-d56a-4c7a-a01e-17f5579913e4-kube-api-access-8p9sv\") pod \"node-resolver-5xr57\" (UID: \"5028d8be-d56a-4c7a-a01e-17f5579913e4\") " pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.574097 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.573978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6h89\" (UniqueName: \"kubernetes.io/projected/c8df0dcc-e346-46ed-ac90-89794ce063c4-kube-api-access-n6h89\") pod \"node-ca-w69dp\" (UID: \"c8df0dcc-e346-46ed-ac90-89794ce063c4\") " pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.574286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.574269 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhnf\" (UniqueName: \"kubernetes.io/projected/d845ee5b-2fdc-401a-8ad3-8f05582b7ea3-kube-api-access-nlhnf\") pod \"iptables-alerter-fmcjg\" (UID: \"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3\") " pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.574377 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.574356 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfg4q\" (UniqueName: \"kubernetes.io/projected/1fd2f49f-a4e3-4b9d-8d63-2116d20227cb-kube-api-access-rfg4q\") pod \"ovnkube-node-rw7tr\" (UID: \"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb\") " pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.655488 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.655391 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9hclj" Jun 11 00:01:11.664009 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.663977 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" Jun 11 00:01:11.672794 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.672773 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:11.677487 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.677466 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" Jun 11 00:01:11.683060 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.683039 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" Jun 11 00:01:11.689699 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.689683 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-w69dp" Jun 11 00:01:11.695256 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.695238 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:11.701957 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.701938 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fmcjg" Jun 11 00:01:11.705491 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.705474 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5xr57" Jun 11 00:01:11.864190 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.864163 2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 00:01:11.969650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.969583 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:11.969650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:11.969632 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:11.969833 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.969712 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:11.969833 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.969713 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:11.969833 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.969765 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:12.96974818 +0000 UTC m=+4.004124715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:11.969833 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:11.969784 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:12.969773269 +0000 UTC m=+4.004149804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:12.070845 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.070813 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:12.071006 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.070950 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:12.071006 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.070967 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:12.071006 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.070976 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:12.071144 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.071028 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:13.07101244 +0000 UTC m=+4.105388986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:12.168400 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.168372 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1579d680_56e3_464c_8c0b_4b5bcfff9a6a.slice/crio-37e921fcabe99fb35757ec750c35aedbf8086b596aba629a85845d59eaa3c04d WatchSource:0}: Error finding container 37e921fcabe99fb35757ec750c35aedbf8086b596aba629a85845d59eaa3c04d: Status 404 returned error can't find the container with id 37e921fcabe99fb35757ec750c35aedbf8086b596aba629a85845d59eaa3c04d Jun 11 00:01:12.169988 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.169958 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8df0dcc_e346_46ed_ac90_89794ce063c4.slice/crio-d62a67b55d5ea932de3323f541dac4b6dd435dcef79bfef0fb6827a877ec3b70 WatchSource:0}: Error finding container d62a67b55d5ea932de3323f541dac4b6dd435dcef79bfef0fb6827a877ec3b70: Status 404 returned error can't find the container with id d62a67b55d5ea932de3323f541dac4b6dd435dcef79bfef0fb6827a877ec3b70 Jun 11 00:01:12.170569 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.170552 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5028d8be_d56a_4c7a_a01e_17f5579913e4.slice/crio-d3cf2b644c040a2dad614549e1ecc00e3d9269831545b35f6b2fd53ab0ed2582 WatchSource:0}: Error finding container d3cf2b644c040a2dad614549e1ecc00e3d9269831545b35f6b2fd53ab0ed2582: Status 404 returned error can't find the container with id d3cf2b644c040a2dad614549e1ecc00e3d9269831545b35f6b2fd53ab0ed2582 Jun 11 00:01:12.172531 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.172249 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60908e2_edf4_4e65_88c5_99895dae5946.slice/crio-c9d59623ae2ed81749455c03075270c2bb1ca329edf8cde21230c42a39db04fe WatchSource:0}: Error finding container c9d59623ae2ed81749455c03075270c2bb1ca329edf8cde21230c42a39db04fe: Status 404 returned error can't find the container with id c9d59623ae2ed81749455c03075270c2bb1ca329edf8cde21230c42a39db04fe Jun 11 00:01:12.175660 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.175640 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03afd107_494a_41a2_bfcb_cab57d031808.slice/crio-1d2e2ce4a7298f364f4589a89e070a749217a17209b863f1b490d8f94bfc4efa WatchSource:0}: Error finding container 1d2e2ce4a7298f364f4589a89e070a749217a17209b863f1b490d8f94bfc4efa: Status 404 returned error can't find the container with id 1d2e2ce4a7298f364f4589a89e070a749217a17209b863f1b490d8f94bfc4efa Jun 11 00:01:12.176931 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.176848 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd845ee5b_2fdc_401a_8ad3_8f05582b7ea3.slice/crio-20e3179d406c85f0b7e02124b0a8c196811a9ae9a744196283ea2071186d2876 WatchSource:0}: Error finding container 20e3179d406c85f0b7e02124b0a8c196811a9ae9a744196283ea2071186d2876: Status 404 returned error can't find the container with id 20e3179d406c85f0b7e02124b0a8c196811a9ae9a744196283ea2071186d2876 Jun 11 00:01:12.178149 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.178120 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fd2f49f_a4e3_4b9d_8d63_2116d20227cb.slice/crio-70b21ecb181ccc942bf06a67649051fa2cf38f8e8cbc0d220d8835b739bed790 WatchSource:0}: Error finding container 70b21ecb181ccc942bf06a67649051fa2cf38f8e8cbc0d220d8835b739bed790: Status 404 returned error can't find the container with id 70b21ecb181ccc942bf06a67649051fa2cf38f8e8cbc0d220d8835b739bed790 Jun 11 00:01:12.179556 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.179536 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda14161ea_8dbd_4030_bb1a_64387354a2d4.slice/crio-6a66dce9a71f89209c41e1fb5d1e5f1de85a3146d5995616f99a9aa3be9101a9 WatchSource:0}: Error finding container 6a66dce9a71f89209c41e1fb5d1e5f1de85a3146d5995616f99a9aa3be9101a9: Status 404 returned error can't find the container with id 6a66dce9a71f89209c41e1fb5d1e5f1de85a3146d5995616f99a9aa3be9101a9 Jun 11 00:01:12.181578 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:12.181546 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34d6d91e_5c3f_4076_a279_5a929d23603c.slice/crio-5b6c72ae67f012f76002a500459b1ebf19173c93c8ad32c52492d4bc3033acc7 WatchSource:0}: Error finding container 5b6c72ae67f012f76002a500459b1ebf19173c93c8ad32c52492d4bc3033acc7: Status 404 returned error can't find the container with id 5b6c72ae67f012f76002a500459b1ebf19173c93c8ad32c52492d4bc3033acc7 Jun 11 00:01:12.387141 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.386965 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 23:56:11 +0000 UTC" deadline="2028-01-27 03:58:54.347698259 +0000 UTC" Jun 11 00:01:12.387141 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.387145 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14283h57m41.96056167s" Jun 11 00:01:12.419508 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.419486 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:12.419643 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.419580 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:12.426557 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.426532 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82tcd" event={"ID":"a14161ea-8dbd-4030-bb1a-64387354a2d4","Type":"ContainerStarted","Data":"6a66dce9a71f89209c41e1fb5d1e5f1de85a3146d5995616f99a9aa3be9101a9"} Jun 11 00:01:12.427874 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.427843 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmcjg" event={"ID":"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3","Type":"ContainerStarted","Data":"20e3179d406c85f0b7e02124b0a8c196811a9ae9a744196283ea2071186d2876"} Jun 11 00:01:12.429083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.429056 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerStarted","Data":"1d2e2ce4a7298f364f4589a89e070a749217a17209b863f1b490d8f94bfc4efa"} Jun 11 00:01:12.430092 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.430067 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xr57" event={"ID":"5028d8be-d56a-4c7a-a01e-17f5579913e4","Type":"ContainerStarted","Data":"d3cf2b644c040a2dad614549e1ecc00e3d9269831545b35f6b2fd53ab0ed2582"} Jun 11 00:01:12.431195 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.431171 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w69dp" event={"ID":"c8df0dcc-e346-46ed-ac90-89794ce063c4","Type":"ContainerStarted","Data":"d62a67b55d5ea932de3323f541dac4b6dd435dcef79bfef0fb6827a877ec3b70"} Jun 11 00:01:12.432352 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.432319 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" event={"ID":"1579d680-56e3-464c-8c0b-4b5bcfff9a6a","Type":"ContainerStarted","Data":"37e921fcabe99fb35757ec750c35aedbf8086b596aba629a85845d59eaa3c04d"} Jun 11 00:01:12.434059 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.434040 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" event={"ID":"c1e0b09ec255377f0d61fd9741eb78d3","Type":"ContainerStarted","Data":"c2c31079deff78579fe4f391285c74553f4150184070720197d5e8ec5aa9fd35"} Jun 11 00:01:12.440886 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.440863 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" event={"ID":"34d6d91e-5c3f-4076-a279-5a929d23603c","Type":"ContainerStarted","Data":"5b6c72ae67f012f76002a500459b1ebf19173c93c8ad32c52492d4bc3033acc7"} Jun 11 00:01:12.441981 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.441963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"70b21ecb181ccc942bf06a67649051fa2cf38f8e8cbc0d220d8835b739bed790"} Jun 11 00:01:12.442982 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.442963 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hclj" event={"ID":"c60908e2-edf4-4e65-88c5-99895dae5946","Type":"ContainerStarted","Data":"c9d59623ae2ed81749455c03075270c2bb1ca329edf8cde21230c42a39db04fe"} Jun 11 00:01:12.451007 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.450967 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-70.ec2.internal" podStartSLOduration=2.450954959 podStartE2EDuration="2.450954959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:12.45058186 +0000 UTC m=+3.484958414" watchObservedRunningTime="2026-06-11 00:01:12.450954959 +0000 UTC m=+3.485331512" Jun 11 00:01:12.975969 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.975929 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:12.976143 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:12.976012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:12.976219 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.976149 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:12.976269 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.976233 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:14.976197233 +0000 UTC m=+6.010573767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:12.976666 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.976644 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:12.976740 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:12.976702 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:14.976686293 +0000 UTC m=+6.011062828 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:13.076760 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.076722 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:13.076923 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.076879 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:13.076923 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.076898 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:13.076923 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.076910 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:13.077093 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.076966 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:15.076950237 +0000 UTC m=+6.111326771 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:13.387433 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.387279 2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 23:56:11 +0000 UTC" deadline="2027-11-16 16:24:50.839800991 +0000 UTC" Jun 11 00:01:13.387433 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.387339 2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12568h23m37.452467003s" Jun 11 00:01:13.423021 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.421863 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:13.423021 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.422026 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:13.423021 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.422515 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:13.423021 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:13.422619 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:13.454572 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.453493 2558 generic.go:356] "Generic (PLEG): container finished" podID="f413e70b6b3053aef7174cee704a950c" containerID="5dbdd564791c7aa56d23e627dd909144f63a8a0ca55ac19a56e824e9bbd7e59a" exitCode=0 Jun 11 00:01:13.454572 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:13.454357 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"f413e70b6b3053aef7174cee704a950c","Type":"ContainerDied","Data":"5dbdd564791c7aa56d23e627dd909144f63a8a0ca55ac19a56e824e9bbd7e59a"} Jun 11 00:01:14.419993 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:14.419495 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:14.419993 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:14.419635 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:14.468684 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:14.468647 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" event={"ID":"f413e70b6b3053aef7174cee704a950c","Type":"ContainerStarted","Data":"6f72dc8daaddca8223151a1fbc9da323fc86e8fb6fbab53c5fe4b8fd7941606d"} Jun 11 00:01:14.994156 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:14.994119 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:14.994355 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:14.994192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:14.994355 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:14.994337 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:14.994552 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:14.994404 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:18.994385192 +0000 UTC m=+10.028761741 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:14.994942 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:14.994817 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:14.994942 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:14.994878 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:18.994860481 +0000 UTC m=+10.029237017 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:15.095379 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:15.094752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:15.095379 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.094942 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:15.095379 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.094969 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:15.095379 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.094982 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:15.095379 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.095042 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:19.095024144 +0000 UTC m=+10.129400701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:15.418935 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:15.418853 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:15.419106 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.419015 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:15.419323 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:15.419287 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:15.419451 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:15.419406 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:16.419310 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:16.419166 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:16.419773 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:16.419312 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:17.418881 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:17.418750 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:17.419062 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:17.418886 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:17.419373 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:17.419158 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:17.419373 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:17.419333 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:18.419034 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:18.418997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:18.419196 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:18.419142 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:19.027915 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:19.027831 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:19.028367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:19.028010 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:19.028367 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.028032 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:19.028367 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.028111 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:27.028089877 +0000 UTC m=+18.062466411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:19.028367 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.028118 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:19.028367 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.028172 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:27.028154384 +0000 UTC m=+18.062530933 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:19.128748 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:19.128711 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:19.128922 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.128896 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:19.128922 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.128921 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:19.129035 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.128936 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:19.129035 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.129001 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:27.128981043 +0000 UTC m=+18.163357599 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:19.422098 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:19.422018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:19.422249 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.422149 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:19.422526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:19.422506 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:19.422623 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:19.422602 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:20.419054 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:20.418904 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:20.419054 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:20.419047 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:21.418608 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:21.418567 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:21.418608 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:21.418585 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:21.418837 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:21.418689 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:21.418837 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:21.418820 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:22.419320 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:22.419286 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:22.419685 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:22.419389 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:23.419658 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:23.419626 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:23.420066 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:23.419760 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:23.420066 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:23.419813 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:23.420066 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:23.419987 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:24.419100 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:24.419068 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:24.419285 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:24.419197 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:25.418577 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:25.418548 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:25.418577 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:25.418576 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:25.419117 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:25.418673 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:25.419117 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:25.418823 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:26.419038 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:26.419011 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:26.419376 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:26.419101 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:27.091101 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:27.091060 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:27.091290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:27.091143 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:27.091290 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.091195 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:27.091290 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.091262 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:27.091290 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.091283 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:01:43.091259334 +0000 UTC m=+34.125635869 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:27.091488 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.091312 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:01:43.091295479 +0000 UTC m=+34.125672013 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:27.192259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:27.192215 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:27.192453 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.192395 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:27.192453 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.192432 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:27.192453 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.192447 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:27.192604 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.192511 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:01:43.192492524 +0000 UTC m=+34.226869057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:27.419236 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:27.419098 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:27.419236 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:27.419138 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:27.419758 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.419317 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:27.419758 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:27.419434 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:28.419496 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:28.419461 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:28.419997 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:28.419597 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:29.420387 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:29.420288 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:29.420867 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:29.420412 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:29.420867 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:29.420464 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:29.420867 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:29.420562 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:30.419140 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:30.419100 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:30.419333 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:30.419224 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:31.418840 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.418619 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:31.419319 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.418669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:31.419319 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:31.418966 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:31.419319 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:31.419015 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:31.509479 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.509293 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-82tcd" event={"ID":"a14161ea-8dbd-4030-bb1a-64387354a2d4","Type":"ContainerStarted","Data":"69ea783385dd0cda1c68dc03ba24dc30bdb11646b5d75be3fa517982a1e61a00"} Jun 11 00:01:31.510974 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.510946 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="d45f7c3617632d66e3be500a7265033630e7612d549d484e41c10615448f23eb" exitCode=0 Jun 11 00:01:31.511071 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.511027 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"d45f7c3617632d66e3be500a7265033630e7612d549d484e41c10615448f23eb"} Jun 11 00:01:31.512766 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.512738 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5xr57" event={"ID":"5028d8be-d56a-4c7a-a01e-17f5579913e4","Type":"ContainerStarted","Data":"2047f68367882672a99d3cb5cb3087b44cdcb62c49c1f93eb7de2ebf00a142b8"} Jun 11 00:01:31.514276 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.514248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-w69dp" event={"ID":"c8df0dcc-e346-46ed-ac90-89794ce063c4","Type":"ContainerStarted","Data":"3b3d71a8fe4cdce1eeab40206b77119cbed71e03d2a2eed3b12c9fc2aba3cbcf"} Jun 11 00:01:31.515697 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.515673 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" event={"ID":"1579d680-56e3-464c-8c0b-4b5bcfff9a6a","Type":"ContainerStarted","Data":"7cd676e6a76b41284f29dd3dc310645ca1eb9409d7cc0c4aeb3417e4974f0085"} Jun 11 00:01:31.518845 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.518825 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" event={"ID":"34d6d91e-5c3f-4076-a279-5a929d23603c","Type":"ContainerStarted","Data":"574ce97d47232bf41fdd4f9c73fefb210a040c81749ec17e71db66188241cc81"} Jun 11 00:01:31.520598 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.520579 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:01:31.520914 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.520895 2558 generic.go:356] "Generic (PLEG): container finished" podID="1fd2f49f-a4e3-4b9d-8d63-2116d20227cb" containerID="ee834785a989bbc0d486f2ebfad4106415cad4b26572fc5614146defed68cff8" exitCode=1 Jun 11 00:01:31.520987 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.520970 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerDied","Data":"ee834785a989bbc0d486f2ebfad4106415cad4b26572fc5614146defed68cff8"} Jun 11 00:01:31.521061 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.521046 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"6b550112406454bf76e144b8cf20e8109bce59a044fcb7666db37921ccb639ee"} Jun 11 00:01:31.522186 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.522167 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9hclj" event={"ID":"c60908e2-edf4-4e65-88c5-99895dae5946","Type":"ContainerStarted","Data":"f96acf2763f4247b192b4d39c3474269bf612d634c416579e506fca44f8d25cb"} Jun 11 00:01:31.525599 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.524127 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-70.ec2.internal" podStartSLOduration=21.524110473 podStartE2EDuration="21.524110473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:14.48368616 +0000 UTC m=+5.518062717" watchObservedRunningTime="2026-06-11 00:01:31.524110473 +0000 UTC m=+22.558487028" Jun 11 00:01:31.525599 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.524346 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-82tcd" podStartSLOduration=3.9461166800000003 podStartE2EDuration="22.52433688s" totalImagesPullingTime="18.5782202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:31.523193155 +0000 UTC m=+22.557569714" watchObservedRunningTime="2026-06-11 00:01:31.52433688 +0000 UTC m=+22.558713438" Jun 11 00:01:31.537336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.537241 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-w69dp" podStartSLOduration=3.9069105090000003 podStartE2EDuration="22.537229222s" totalImagesPullingTime="18.630318713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:31.537002043 +0000 UTC m=+22.571378598" watchObservedRunningTime="2026-06-11 00:01:31.537229222 +0000 UTC m=+22.571605774" Jun 11 00:01:31.550229 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.550191 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5xr57" podStartSLOduration=3.894293931 podStartE2EDuration="22.550181219s" totalImagesPullingTime="18.655887288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:31.550115393 +0000 UTC m=+22.584491947" watchObservedRunningTime="2026-06-11 00:01:31.550181219 +0000 UTC m=+22.584557773" Jun 11 00:01:31.567523 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.567487 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9hclj" podStartSLOduration=3.905876638 podStartE2EDuration="22.567476481s" totalImagesPullingTime="18.661599843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:31.567008288 +0000 UTC m=+22.601384844" watchObservedRunningTime="2026-06-11 00:01:31.567476481 +0000 UTC m=+22.601853034" Jun 11 00:01:31.602526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:31.602486 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wrhc6" podStartSLOduration=3.942427995 podStartE2EDuration="22.602471486s" totalImagesPullingTime="18.660043491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:31.601880803 +0000 UTC m=+22.636257360" watchObservedRunningTime="2026-06-11 00:01:31.602471486 +0000 UTC m=+22.636848039" Jun 11 00:01:32.375160 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.375132 2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 00:01:32.418867 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.418843 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:32.419329 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:32.418970 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:32.425350 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.425264 2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T00:01:32.375157124Z","UUID":"d48e237f-361c-4199-a67c-4c833e4bd3ca","Handler":null,"Name":"","Endpoint":""} Jun 11 00:01:32.426807 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.426788 2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 00:01:32.426913 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.426827 2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 00:01:32.526751 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.526668 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" event={"ID":"34d6d91e-5c3f-4076-a279-5a929d23603c","Type":"ContainerStarted","Data":"fe7df46f8830de89e00d2e3e46a4573a595879f42df3b000b559d55a7911b328"} Jun 11 00:01:32.529869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.529847 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:01:32.530344 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.530310 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"b3683626bd2abe0cf339040059143272f3675fd89f8c834408f224c1e7658a08"} Jun 11 00:01:32.530468 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.530389 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"70de7feb89a871edf4ac62560ed8fbc25513716afe5b2fade5a586c871dfa198"} Jun 11 00:01:32.530468 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.530460 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"8aca2845d12579ce7ac0879e27be30d2656416d1065b0542d5549b36ed8eb9a9"} Jun 11 00:01:32.530584 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.530510 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"e4419d411eee3bb3650898fd59483441eb4439ecce34c3ccfa990b2e5cd06bba"} Jun 11 00:01:32.531803 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.531763 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fmcjg" event={"ID":"d845ee5b-2fdc-401a-8ad3-8f05582b7ea3","Type":"ContainerStarted","Data":"b1f44ca3ea830391f5d052159787b255725f6cf507f7b82a80ee1a3e884539ce"} Jun 11 00:01:32.547985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:32.547937 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fmcjg" podStartSLOduration=4.891770477 podStartE2EDuration="23.547920407s" totalImagesPullingTime="18.65614993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:32.547632424 +0000 UTC m=+23.582008997" watchObservedRunningTime="2026-06-11 00:01:32.547920407 +0000 UTC m=+23.582296961" Jun 11 00:01:33.211952 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.211917 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:33.212560 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.212536 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:33.418835 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.418758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:33.418835 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.418758 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:33.419348 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:33.418903 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:33.419348 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:33.419024 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:33.533834 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.533781 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:33.534208 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:33.534188 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-82tcd" Jun 11 00:01:34.419338 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:34.419078 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:34.419801 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:34.419397 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:34.538353 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:34.538313 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" event={"ID":"34d6d91e-5c3f-4076-a279-5a929d23603c","Type":"ContainerStarted","Data":"f03859a1fd5cf90abaf3366f6faa3cbccf9074a0a7209332914db17fdde46460"} Jun 11 00:01:34.541624 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:34.541597 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:01:34.542059 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:34.542032 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"3045081cc9ee599715aad1d2e73221050eb3dfe355632787814baf98f9aee3d6"} Jun 11 00:01:34.553927 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:34.553877 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8d42k" podStartSLOduration=4.811561643 podStartE2EDuration="25.553858664s" totalImagesPullingTime="20.742297021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:34.553410646 +0000 UTC m=+25.587787199" watchObservedRunningTime="2026-06-11 00:01:34.553858664 +0000 UTC m=+25.588235220" Jun 11 00:01:35.419092 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:35.419052 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:35.419316 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:35.419060 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:35.419316 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:35.419217 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:35.419316 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:35.419258 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:36.419311 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.419044 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:36.419573 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:36.419334 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:36.547760 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.547719 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="5f0bc849a1a1e5320600cfe5971bb27e948be16e909ffb0879dd0d6bd4182925" exitCode=0 Jun 11 00:01:36.547934 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.547803 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"5f0bc849a1a1e5320600cfe5971bb27e948be16e909ffb0879dd0d6bd4182925"} Jun 11 00:01:36.551437 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.551401 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:01:36.551862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.551839 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"25d7d4c46cf8d2c6e0777eec1112ef119147a4c5c3164ea1a220f684c27d521e"} Jun 11 00:01:36.552085 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.552064 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:36.552192 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.552130 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:36.552252 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.552240 2558 scope.go:117] "RemoveContainer" containerID="ee834785a989bbc0d486f2ebfad4106415cad4b26572fc5614146defed68cff8" Jun 11 00:01:36.567973 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.567951 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:36.568102 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:36.568084 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:37.421035 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:37.420997 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:37.421666 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:37.421154 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:37.421666 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:37.421154 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:37.421666 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:37.421290 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:37.557970 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:37.557944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:01:37.558273 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:37.558253 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" event={"ID":"1fd2f49f-a4e3-4b9d-8d63-2116d20227cb","Type":"ContainerStarted","Data":"d8a7dd249ba1febdd5ff26e38ff8ecc5e1ae7efef336ce2825a6c7966ee4df34"} Jun 11 00:01:37.558344 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:37.558331 2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 00:01:38.149582 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.149458 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" podStartSLOduration=10.141922034 podStartE2EDuration="29.149415975s" totalImagesPullingTime="19.007493941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:37.583085086 +0000 UTC m=+28.617461640" watchObservedRunningTime="2026-06-11 00:01:38.149415975 +0000 UTC m=+29.183792529" Jun 11 00:01:38.150102 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.150086 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvrbw"] Jun 11 00:01:38.150209 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.150198 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:38.150333 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:38.150315 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:38.153391 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.153363 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28x5s"] Jun 11 00:01:38.153520 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.153487 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:38.153626 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:38.153598 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:38.154026 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.153998 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wmmj"] Jun 11 00:01:38.154097 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.154070 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:38.154162 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:38.154143 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:38.392047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.392010 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:01:38.562617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.562534 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="5f24bbe42c6da1545a40c5f2b050c760765d6eb89ecefd4657601e9e530c0f7c" exitCode=0 Jun 11 00:01:38.562967 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:38.562628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"5f24bbe42c6da1545a40c5f2b050c760765d6eb89ecefd4657601e9e530c0f7c"} Jun 11 00:01:39.419707 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:39.419672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:39.419897 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:39.419781 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:39.419963 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:39.419779 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:39.419963 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:39.419895 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:40.419577 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:40.419382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:40.419949 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:40.419652 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:40.569120 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:40.569032 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="286d28f75d8ad1691f9b75207537b9d15d1ad3cc25bc2eccbc4eca6820d9c07f" exitCode=0 Jun 11 00:01:40.569120 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:40.569069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"286d28f75d8ad1691f9b75207537b9d15d1ad3cc25bc2eccbc4eca6820d9c07f"} Jun 11 00:01:41.419364 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:41.419319 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:41.419364 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:41.419341 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:41.419616 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:41.419495 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:41.420058 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:41.419613 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:42.418967 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:42.418934 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:42.419146 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:42.419069 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:43.110893 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:43.110807 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:43.110893 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:43.110875 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:43.111482 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.110971 2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:43.111482 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.111026 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret podName:84ff857a-d5d2-41b3-9876-5106e2f822bf nodeName:}" failed. No retries permitted until 2026-06-11 00:02:15.111012885 +0000 UTC m=+66.145389420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret") pod "global-pull-secret-syncer-rvrbw" (UID: "84ff857a-d5d2-41b3-9876-5106e2f822bf") : object "kube-system"/"original-pull-secret" not registered Jun 11 00:01:43.111482 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.110973 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:43.111482 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.111069 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:02:15.111059901 +0000 UTC m=+66.145436448 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 00:01:43.211436 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:43.211373 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:43.211583 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.211543 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 00:01:43.211583 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.211570 2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 00:01:43.211583 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.211584 2558 projected.go:196] Error preparing data for projected volume kube-api-access-bz9l5 for pod openshift-network-diagnostics/network-check-target-7wmmj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:43.211708 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.211649 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5 podName:1d6362a8-bb47-4b67-a695-08a3e690ebdb nodeName:}" failed. No retries permitted until 2026-06-11 00:02:15.211630181 +0000 UTC m=+66.246006730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bz9l5" (UniqueName: "kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5") pod "network-check-target-7wmmj" (UID: "1d6362a8-bb47-4b67-a695-08a3e690ebdb") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 00:01:43.419564 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:43.419487 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:43.419564 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:43.419540 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:43.419782 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.419640 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:01:43.419782 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:43.419764 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7wmmj" podUID="1d6362a8-bb47-4b67-a695-08a3e690ebdb" Jun 11 00:01:44.418817 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.418786 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:44.419283 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:44.418883 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rvrbw" podUID="84ff857a-d5d2-41b3-9876-5106e2f822bf" Jun 11 00:01:44.581737 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.581703 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerStarted","Data":"70484bf3ba465e84678388c1e1d8de62fac137ae60db0f76dc246b8c02a2d1da"} Jun 11 00:01:44.812742 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.812713 2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-70.ec2.internal" event="NodeReady" Jun 11 00:01:44.812934 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.812863 2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 00:01:44.856574 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.856542 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xblr4"] Jun 11 00:01:44.858330 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.858310 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:44.859243 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.859224 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-l6h42"] Jun 11 00:01:44.860734 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.860710 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 00:01:44.860826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.860750 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 00:01:44.860826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.860792 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7rjx2\"" Jun 11 00:01:44.861123 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.861103 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:44.863075 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.863058 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j2cg8\"" Jun 11 00:01:44.863233 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.863222 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 00:01:44.863290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.863225 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 00:01:44.863504 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.863492 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 00:01:44.868186 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.868163 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xblr4"] Jun 11 00:01:44.871786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:44.871636 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6h42"] Jun 11 00:01:45.024438 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024382 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.024622 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024448 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh7c2\" (UniqueName: \"kubernetes.io/projected/8626ce16-c5fb-4255-93bd-062aa41817c2-kube-api-access-bh7c2\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.024622 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024482 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8626ce16-c5fb-4255-93bd-062aa41817c2-tmp-dir\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.024622 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024499 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8626ce16-c5fb-4255-93bd-062aa41817c2-config-volume\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.024622 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v69dq\" (UniqueName: \"kubernetes.io/projected/fcd43112-182d-4122-a6c3-73cab83ce955-kube-api-access-v69dq\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.024622 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.024570 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcd43112-182d-4122-a6c3-73cab83ce955-cert\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.125794 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125697 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v69dq\" (UniqueName: \"kubernetes.io/projected/fcd43112-182d-4122-a6c3-73cab83ce955-kube-api-access-v69dq\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.125794 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125751 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcd43112-182d-4122-a6c3-73cab83ce955-cert\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125800 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125837 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh7c2\" (UniqueName: \"kubernetes.io/projected/8626ce16-c5fb-4255-93bd-062aa41817c2-kube-api-access-bh7c2\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8626ce16-c5fb-4255-93bd-062aa41817c2-tmp-dir\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.125899 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8626ce16-c5fb-4255-93bd-062aa41817c2-config-volume\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:45.125912 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:01:45.125985 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:45.125979 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:01:45.625957928 +0000 UTC m=+36.660334483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:01:45.126253 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.126235 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8626ce16-c5fb-4255-93bd-062aa41817c2-tmp-dir\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.126561 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.126538 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8626ce16-c5fb-4255-93bd-062aa41817c2-config-volume\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.129960 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.129940 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fcd43112-182d-4122-a6c3-73cab83ce955-cert\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.136117 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.136089 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh7c2\" (UniqueName: \"kubernetes.io/projected/8626ce16-c5fb-4255-93bd-062aa41817c2-kube-api-access-bh7c2\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.136298 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.136283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v69dq\" (UniqueName: \"kubernetes.io/projected/fcd43112-182d-4122-a6c3-73cab83ce955-kube-api-access-v69dq\") pod \"ingress-canary-l6h42\" (UID: \"fcd43112-182d-4122-a6c3-73cab83ce955\") " pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.174331 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.174305 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-l6h42" Jun 11 00:01:45.303860 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.303828 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-l6h42"] Jun 11 00:01:45.307565 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:01:45.307536 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd43112_182d_4122_a6c3_73cab83ce955.slice/crio-5cf9642b459c29bbbf3c147e6e04c9769b0a9427f3d4b8246f86168b77817793 WatchSource:0}: Error finding container 5cf9642b459c29bbbf3c147e6e04c9769b0a9427f3d4b8246f86168b77817793: Status 404 returned error can't find the container with id 5cf9642b459c29bbbf3c147e6e04c9769b0a9427f3d4b8246f86168b77817793 Jun 11 00:01:45.419288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.419190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:01:45.419732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.419458 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:01:45.421869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.421845 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 00:01:45.421978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.421869 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 00:01:45.421978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.421881 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fnk6\"" Jun 11 00:01:45.422148 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.422109 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 00:01:45.422250 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.422176 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-75lrw\"" Jun 11 00:01:45.586746 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.586709 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="70484bf3ba465e84678388c1e1d8de62fac137ae60db0f76dc246b8c02a2d1da" exitCode=0 Jun 11 00:01:45.586933 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.586796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"70484bf3ba465e84678388c1e1d8de62fac137ae60db0f76dc246b8c02a2d1da"} Jun 11 00:01:45.588121 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.587872 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6h42" event={"ID":"fcd43112-182d-4122-a6c3-73cab83ce955","Type":"ContainerStarted","Data":"5cf9642b459c29bbbf3c147e6e04c9769b0a9427f3d4b8246f86168b77817793"} Jun 11 00:01:45.629787 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:45.629748 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:45.629974 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:45.629932 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:01:45.630039 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:45.630017 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:01:46.629994291 +0000 UTC m=+37.664370843 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:01:46.419349 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:46.419311 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:01:46.421975 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:46.421949 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 00:01:46.594376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:46.594339 2558 generic.go:356] "Generic (PLEG): container finished" podID="03afd107-494a-41a2-bfcb-cab57d031808" containerID="04d0da7967db31786e93eb4ab95fc152ee826937cb0b6ce48e23b66e6d914315" exitCode=0 Jun 11 00:01:46.594565 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:46.594397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerDied","Data":"04d0da7967db31786e93eb4ab95fc152ee826937cb0b6ce48e23b66e6d914315"} Jun 11 00:01:46.637658 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:46.637622 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:46.637828 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:46.637771 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:01:46.637879 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:46.637835 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:01:48.637815687 +0000 UTC m=+39.672192242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:01:47.598762 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:47.598508 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-l6h42" event={"ID":"fcd43112-182d-4122-a6c3-73cab83ce955","Type":"ContainerStarted","Data":"e70f832fe096db4b4e75905c7d36cf309e662e0f5282501735a9f45356f52ecc"} Jun 11 00:01:47.602895 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:47.602865 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" event={"ID":"03afd107-494a-41a2-bfcb-cab57d031808","Type":"ContainerStarted","Data":"4488b5bf8e9550af025011e80dbb1af785bc3d8980fc76fc997b4194d58852fb"} Jun 11 00:01:47.612870 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:47.612823 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-l6h42" podStartSLOduration=1.9751373239999999 podStartE2EDuration="3.612809647s" totalImagesPullingTime="1.637672323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:47.612495852 +0000 UTC m=+38.646872410" watchObservedRunningTime="2026-06-11 00:01:47.612809647 +0000 UTC m=+38.647186201" Jun 11 00:01:47.631568 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:47.631498 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mzqrh" podStartSLOduration=9.675639848 podStartE2EDuration="38.631480618s" totalImagesPullingTime="28.95584077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:01:47.630014691 +0000 UTC m=+38.664391269" watchObservedRunningTime="2026-06-11 00:01:47.631480618 +0000 UTC m=+38.665857172" Jun 11 00:01:48.653021 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:48.652992 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:48.653499 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:48.653163 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:01:48.653499 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:48.653281 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:01:52.6532597 +0000 UTC m=+43.687636256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:01:52.676753 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:01:52.676710 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:01:52.677126 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:52.676841 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:01:52.677126 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:01:52.676909 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:02:00.676882925 +0000 UTC m=+51.711259474 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:02:00.729510 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:00.729467 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:02:00.730033 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:00.729609 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:02:00.730033 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:00.729680 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:02:16.729664005 +0000 UTC m=+67.764040542 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:02:09.586053 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:09.586020 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rw7tr" Jun 11 00:02:15.134185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.134132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:02:15.134185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.134202 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:02:15.137102 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.137081 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 00:02:15.137217 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.137199 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 00:02:15.145101 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:15.145079 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 00:02:15.145163 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:15.145153 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:03:19.145136432 +0000 UTC m=+130.179512964 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : secret "metrics-daemon-secret" not found Jun 11 00:02:15.148618 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.148600 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/84ff857a-d5d2-41b3-9876-5106e2f822bf-original-pull-secret\") pod \"global-pull-secret-syncer-rvrbw\" (UID: \"84ff857a-d5d2-41b3-9876-5106e2f822bf\") " pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:02:15.229127 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.229088 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rvrbw" Jun 11 00:02:15.235255 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.235233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:02:15.238096 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.238079 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 00:02:15.248171 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.248147 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 00:02:15.259340 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.259315 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9l5\" (UniqueName: \"kubernetes.io/projected/1d6362a8-bb47-4b67-a695-08a3e690ebdb-kube-api-access-bz9l5\") pod \"network-check-target-7wmmj\" (UID: \"1d6362a8-bb47-4b67-a695-08a3e690ebdb\") " pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:02:15.361199 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.361022 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rvrbw"] Jun 11 00:02:15.363735 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:02:15.363705 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ff857a_d5d2_41b3_9876_5106e2f822bf.slice/crio-9958f78d1339f90a8b46d56e847dacf958c68cfa9aa40b5ac3efb004c98e2509 WatchSource:0}: Error finding container 9958f78d1339f90a8b46d56e847dacf958c68cfa9aa40b5ac3efb004c98e2509: Status 404 returned error can't find the container with id 9958f78d1339f90a8b46d56e847dacf958c68cfa9aa40b5ac3efb004c98e2509 Jun 11 00:02:15.431990 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.431916 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fnk6\"" Jun 11 00:02:15.440078 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.440056 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:02:15.554133 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.554097 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7wmmj"] Jun 11 00:02:15.556973 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:02:15.556949 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6362a8_bb47_4b67_a695_08a3e690ebdb.slice/crio-a448c3309280836ab707ba03195fdedc60c0fc84f0b438db4be2af9750efdebc WatchSource:0}: Error finding container a448c3309280836ab707ba03195fdedc60c0fc84f0b438db4be2af9750efdebc: Status 404 returned error can't find the container with id a448c3309280836ab707ba03195fdedc60c0fc84f0b438db4be2af9750efdebc Jun 11 00:02:15.668364 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.668324 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wmmj" event={"ID":"1d6362a8-bb47-4b67-a695-08a3e690ebdb","Type":"ContainerStarted","Data":"a448c3309280836ab707ba03195fdedc60c0fc84f0b438db4be2af9750efdebc"} Jun 11 00:02:15.669320 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:15.669295 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvrbw" event={"ID":"84ff857a-d5d2-41b3-9876-5106e2f822bf","Type":"ContainerStarted","Data":"9958f78d1339f90a8b46d56e847dacf958c68cfa9aa40b5ac3efb004c98e2509"} Jun 11 00:02:16.747578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:16.747537 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:02:16.748054 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:16.747680 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:02:16.748054 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:16.747740 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:02:48.747723812 +0000 UTC m=+99.782100344 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:02:19.682387 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:19.682351 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7wmmj" event={"ID":"1d6362a8-bb47-4b67-a695-08a3e690ebdb","Type":"ContainerStarted","Data":"d31fc4a66f0526ca8ad6231fa06aa0730160b309da4b30b0b1d352d7014336d8"} Jun 11 00:02:19.682791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:19.682481 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:02:19.697342 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:19.697288 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7wmmj" podStartSLOduration=67.54519297 podStartE2EDuration="1m10.697273126s" totalImagesPullingTime="3.152080156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:02:19.696530805 +0000 UTC m=+70.730907360" watchObservedRunningTime="2026-06-11 00:02:19.697273126 +0000 UTC m=+70.731649679" Jun 11 00:02:21.688791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:21.688756 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rvrbw" event={"ID":"84ff857a-d5d2-41b3-9876-5106e2f822bf","Type":"ContainerStarted","Data":"c24aec0d520033b92ff165dc76957fb88e88266d873a44b2a92aa709dcaa9d80"} Jun 11 00:02:48.758950 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:48.758911 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:02:48.759345 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:48.759069 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:02:48.759345 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:02:48.759144 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:03:52.759129676 +0000 UTC m=+163.793506208 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:02:50.687389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:50.687357 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7wmmj" Jun 11 00:02:50.702478 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:02:50.702414 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rvrbw" podStartSLOduration=95.61538697 podStartE2EDuration="1m41.702398334s" totalImagesPullingTime="6.087011364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:02:21.703213829 +0000 UTC m=+72.737590383" watchObservedRunningTime="2026-06-11 00:02:50.702398334 +0000 UTC m=+101.736774944" Jun 11 00:03:19.161814 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:03:19.161755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:03:19.162306 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:19.161886 2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 00:03:19.162306 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:19.161946 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs podName:a96e0628-ae65-4495-a644-1d920aae686d nodeName:}" failed. No retries permitted until 2026-06-11 00:05:21.161929309 +0000 UTC m=+252.196305841 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs") pod "network-metrics-daemon-28x5s" (UID: "a96e0628-ae65-4495-a644-1d920aae686d") : secret "metrics-daemon-secret" not found Jun 11 00:03:47.868459 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:47.868385 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xblr4" podUID="8626ce16-c5fb-4255-93bd-062aa41817c2" Jun 11 00:03:47.887257 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:03:47.887228 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblr4" Jun 11 00:03:48.434543 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:48.434482 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-28x5s" podUID="a96e0628-ae65-4495-a644-1d920aae686d" Jun 11 00:03:52.789361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:03:52.789304 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:03:52.789882 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:52.789480 2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 00:03:52.789882 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:03:52.789545 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls podName:8626ce16-c5fb-4255-93bd-062aa41817c2 nodeName:}" failed. No retries permitted until 2026-06-11 00:05:54.789526406 +0000 UTC m=+285.823902938 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls") pod "dns-default-xblr4" (UID: "8626ce16-c5fb-4255-93bd-062aa41817c2") : secret "dns-default-metrics-tls" not found Jun 11 00:04:02.418877 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:02.418782 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:04:04.046920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.046884 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9"] Jun 11 00:04:04.048882 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.048862 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" Jun 11 00:04:04.051223 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.051204 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6w42q\"" Jun 11 00:04:04.053290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.053271 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt"] Jun 11 00:04:04.055141 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.055118 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.056543 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.056526 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f698f98d7-6trdv"] Jun 11 00:04:04.058150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.058134 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.059061 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.059042 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 00:04:04.059193 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.059049 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 00:04:04.059303 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.059245 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 00:04:04.059303 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.059282 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wbcr2\"" Jun 11 00:04:04.059411 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.059357 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 00:04:04.060032 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060011 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9"] Jun 11 00:04:04.060797 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060780 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 00:04:04.060933 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060895 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 11 00:04:04.060933 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060912 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 11 00:04:04.061069 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060946 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 00:04:04.061069 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060967 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 11 00:04:04.061069 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.060916 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 11 00:04:04.061337 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.061323 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lj7t7\"" Jun 11 00:04:04.068562 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.068543 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt"] Jun 11 00:04:04.077313 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.077285 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f698f98d7-6trdv"] Jun 11 00:04:04.081242 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.081217 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc"] Jun 11 00:04:04.083135 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.083115 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.085185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.085168 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 00:04:04.085368 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.085354 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 00:04:04.085467 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.085378 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 00:04:04.085467 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.085389 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 00:04:04.094137 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.094113 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc"] Jun 11 00:04:04.153287 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.153254 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-9c8f4bc89-2ghd4"] Jun 11 00:04:04.155270 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.155246 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.157686 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.157663 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 00:04:04.157832 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.157816 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 00:04:04.158026 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.158013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 00:04:04.158118 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.158102 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s695f\"" Jun 11 00:04:04.160717 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160699 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpgrp\" (UniqueName: \"kubernetes.io/projected/de7084ea-54d2-42ad-bc19-89702fad376f-kube-api-access-bpgrp\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.160826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-default-certificate\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.160826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160753 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.160826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.160975 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160855 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5b6\" (UniqueName: \"kubernetes.io/projected/b8763ade-72d9-4ab0-90c7-e1bda25649e1-kube-api-access-xv5b6\") pod \"network-check-source-dbd9cf844-8krf9\" (UID: \"b8763ade-72d9-4ab0-90c7-e1bda25649e1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" Jun 11 00:04:04.160975 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160908 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-stats-auth\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.160975 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.160958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.161126 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.161006 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4s7c\" (UniqueName: \"kubernetes.io/projected/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-kube-api-access-q4s7c\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.161180 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.161128 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de7084ea-54d2-42ad-bc19-89702fad376f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.166775 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.166746 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 00:04:04.171659 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.171635 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-9c8f4bc89-2ghd4"] Jun 11 00:04:04.247230 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.247184 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm"] Jun 11 00:04:04.249058 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.249036 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989"] Jun 11 00:04:04.249202 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.249162 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" Jun 11 00:04:04.250704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.250685 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.251703 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.251678 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 11 00:04:04.251703 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.251694 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-bfvfj\"" Jun 11 00:04:04.251841 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.251711 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 11 00:04:04.252754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.252739 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 11 00:04:04.252827 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.252786 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 11 00:04:04.252940 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.252926 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 11 00:04:04.253119 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.253104 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 11 00:04:04.253602 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.253587 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2nqzv\"" Jun 11 00:04:04.259036 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.259014 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm"] Jun 11 00:04:04.261623 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261596 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de7084ea-54d2-42ad-bc19-89702fad376f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.261727 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261681 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpgrp\" (UniqueName: \"kubernetes.io/projected/de7084ea-54d2-42ad-bc19-89702fad376f-kube-api-access-bpgrp\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.261727 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261712 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-default-certificate\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261742 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a03c9cf-7fae-4c21-a113-55ef4a16988c-tmp\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261770 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261794 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261821 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5b6\" (UniqueName: \"kubernetes.io/projected/b8763ade-72d9-4ab0-90c7-e1bda25649e1-kube-api-access-xv5b6\") pod \"network-check-source-dbd9cf844-8krf9\" (UID: \"b8763ade-72d9-4ab0-90c7-e1bda25649e1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261846 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261869 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.261892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.262010 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.262077 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:04.762058555 +0000 UTC m=+175.796435088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:04.262389 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.262178 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:04.76215713 +0000 UTC m=+175.796533670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/de7084ea-54d2-42ad-bc19-89702fad376f-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-stats-auth\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262820 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262854 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262884 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a03c9cf-7fae-4c21-a113-55ef4a16988c-klusterlet-config\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.262949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262910 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7frmg\" (UniqueName: \"kubernetes.io/projected/7a03c9cf-7fae-4c21-a113-55ef4a16988c-kube-api-access-7frmg\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262958 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.262984 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.263010 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.263053 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4s7c\" (UniqueName: \"kubernetes.io/projected/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-kube-api-access-q4s7c\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.263071 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.263076 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnjn\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.263343 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.263135 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:04.763117422 +0000 UTC m=+175.797493969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:04.265625 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.265607 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-stats-auth\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.265762 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.265742 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-default-certificate\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.270497 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.270465 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989"] Jun 11 00:04:04.275740 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.275717 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpgrp\" (UniqueName: \"kubernetes.io/projected/de7084ea-54d2-42ad-bc19-89702fad376f-kube-api-access-bpgrp\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.278112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.278092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4s7c\" (UniqueName: \"kubernetes.io/projected/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-kube-api-access-q4s7c\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.278193 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.278176 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5b6\" (UniqueName: \"kubernetes.io/projected/b8763ade-72d9-4ab0-90c7-e1bda25649e1-kube-api-access-xv5b6\") pod \"network-check-source-dbd9cf844-8krf9\" (UID: \"b8763ade-72d9-4ab0-90c7-e1bda25649e1\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" Jun 11 00:04:04.358316 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.358232 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" Jun 11 00:04:04.363788 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.363761 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.363938 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.363811 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a03c9cf-7fae-4c21-a113-55ef4a16988c-klusterlet-config\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.364005 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.363933 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7frmg\" (UniqueName: \"kubernetes.io/projected/7a03c9cf-7fae-4c21-a113-55ef4a16988c-kube-api-access-7frmg\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.364005 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.363966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhj87\" (UniqueName: \"kubernetes.io/projected/5a680d33-a66f-439b-82ea-15083c272cc4-kube-api-access-jhj87\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.364116 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364033 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a03c9cf-7fae-4c21-a113-55ef4a16988c-tmp\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.364116 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364078 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364116 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364102 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364260 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364124 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364260 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364157 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctj76\" (UniqueName: \"kubernetes.io/projected/d65cc772-f31f-4119-aa4b-7aa62a6fd0d7-kube-api-access-ctj76\") pod \"volume-data-source-validator-78dd696465-whxpm\" (UID: \"d65cc772-f31f-4119-aa4b-7aa62a6fd0d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" Jun 11 00:04:04.364260 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364260 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364260 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364202 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364501 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.364324 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:04.364501 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.364341 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:04.364501 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.364397 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:04.864375283 +0000 UTC m=+175.898751829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:04.364656 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364499 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7a03c9cf-7fae-4c21-a113-55ef4a16988c-tmp\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.364656 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364233 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364759 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364651 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnjn\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.364759 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364683 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a680d33-a66f-439b-82ea-15083c272cc4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.364759 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.364726 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a680d33-a66f-439b-82ea-15083c272cc4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.365321 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.365297 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.365439 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.365397 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.366703 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.366680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7a03c9cf-7fae-4c21-a113-55ef4a16988c-klusterlet-config\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.366766 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.366726 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.366811 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.366775 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.374386 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.374364 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.374386 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.374377 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7frmg\" (UniqueName: \"kubernetes.io/projected/7a03c9cf-7fae-4c21-a113-55ef4a16988c-kube-api-access-7frmg\") pod \"klusterlet-addon-workmgr-f4fdccc96-v7qfc\" (UID: \"7a03c9cf-7fae-4c21-a113-55ef4a16988c\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.374815 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.374796 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnjn\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.391682 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.391661 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:04.465255 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.465223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctj76\" (UniqueName: \"kubernetes.io/projected/d65cc772-f31f-4119-aa4b-7aa62a6fd0d7-kube-api-access-ctj76\") pod \"volume-data-source-validator-78dd696465-whxpm\" (UID: \"d65cc772-f31f-4119-aa4b-7aa62a6fd0d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" Jun 11 00:04:04.465404 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.465274 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a680d33-a66f-439b-82ea-15083c272cc4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.465404 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.465299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a680d33-a66f-439b-82ea-15083c272cc4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.465404 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.465335 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhj87\" (UniqueName: \"kubernetes.io/projected/5a680d33-a66f-439b-82ea-15083c272cc4-kube-api-access-jhj87\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.466297 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.466268 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5a680d33-a66f-439b-82ea-15083c272cc4-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.468108 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.468083 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5a680d33-a66f-439b-82ea-15083c272cc4-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.473690 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.473660 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhj87\" (UniqueName: \"kubernetes.io/projected/5a680d33-a66f-439b-82ea-15083c272cc4-kube-api-access-jhj87\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-fl989\" (UID: \"5a680d33-a66f-439b-82ea-15083c272cc4\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.473942 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.473921 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctj76\" (UniqueName: \"kubernetes.io/projected/d65cc772-f31f-4119-aa4b-7aa62a6fd0d7-kube-api-access-ctj76\") pod \"volume-data-source-validator-78dd696465-whxpm\" (UID: \"d65cc772-f31f-4119-aa4b-7aa62a6fd0d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" Jun 11 00:04:04.490959 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.490909 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9"] Jun 11 00:04:04.493573 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:04.493548 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8763ade_72d9_4ab0_90c7_e1bda25649e1.slice/crio-c36abbc35145b05581ddf1e5c873e08cf5a0f75febcfeaa5e8fd7df81b203097 WatchSource:0}: Error finding container c36abbc35145b05581ddf1e5c873e08cf5a0f75febcfeaa5e8fd7df81b203097: Status 404 returned error can't find the container with id c36abbc35145b05581ddf1e5c873e08cf5a0f75febcfeaa5e8fd7df81b203097 Jun 11 00:04:04.522978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.522944 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc"] Jun 11 00:04:04.525347 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:04.525315 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a03c9cf_7fae_4c21_a113_55ef4a16988c.slice/crio-ab4fa7fbaa34b840a6c1eb95df94980f042cd70f8046ce22c8d5ec4f52f5a2ab WatchSource:0}: Error finding container ab4fa7fbaa34b840a6c1eb95df94980f042cd70f8046ce22c8d5ec4f52f5a2ab: Status 404 returned error can't find the container with id ab4fa7fbaa34b840a6c1eb95df94980f042cd70f8046ce22c8d5ec4f52f5a2ab Jun 11 00:04:04.559455 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.559415 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" Jun 11 00:04:04.566274 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.566250 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" Jun 11 00:04:04.695571 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.695535 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm"] Jun 11 00:04:04.698773 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:04.698748 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65cc772_f31f_4119_aa4b_7aa62a6fd0d7.slice/crio-33a5264851f7c41258052478a3168e186d4762d42968594e3b6e1c6b720000f5 WatchSource:0}: Error finding container 33a5264851f7c41258052478a3168e186d4762d42968594e3b6e1c6b720000f5: Status 404 returned error can't find the container with id 33a5264851f7c41258052478a3168e186d4762d42968594e3b6e1c6b720000f5 Jun 11 00:04:04.711626 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.711596 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989"] Jun 11 00:04:04.714696 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:04.714660 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a680d33_a66f_439b_82ea_15083c272cc4.slice/crio-701ec6985d70f60e2effa03292c6015253bbd3ff4b7b97e7c95f8386c554e320 WatchSource:0}: Error finding container 701ec6985d70f60e2effa03292c6015253bbd3ff4b7b97e7c95f8386c554e320: Status 404 returned error can't find the container with id 701ec6985d70f60e2effa03292c6015253bbd3ff4b7b97e7c95f8386c554e320 Jun 11 00:04:04.767657 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.767621 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:04.767657 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.767669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.767693 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.767772 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.767788 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.767811 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:05.767792915 +0000 UTC m=+176.802169458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.767831 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:05.767822556 +0000 UTC m=+176.802199093 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:04.767885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.767841 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:05.767836338 +0000 UTC m=+176.802212870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:04.869174 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.869079 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:04.869316 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.869203 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:04.869316 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.869215 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:04.869316 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:04.869264 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:05.869250566 +0000 UTC m=+176.903627098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:04.929247 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.929215 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" event={"ID":"7a03c9cf-7fae-4c21-a113-55ef4a16988c","Type":"ContainerStarted","Data":"ab4fa7fbaa34b840a6c1eb95df94980f042cd70f8046ce22c8d5ec4f52f5a2ab"} Jun 11 00:04:04.930327 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.930299 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" event={"ID":"d65cc772-f31f-4119-aa4b-7aa62a6fd0d7","Type":"ContainerStarted","Data":"33a5264851f7c41258052478a3168e186d4762d42968594e3b6e1c6b720000f5"} Jun 11 00:04:04.931318 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.931297 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" event={"ID":"5a680d33-a66f-439b-82ea-15083c272cc4","Type":"ContainerStarted","Data":"701ec6985d70f60e2effa03292c6015253bbd3ff4b7b97e7c95f8386c554e320"} Jun 11 00:04:04.932736 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.932715 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" event={"ID":"b8763ade-72d9-4ab0-90c7-e1bda25649e1","Type":"ContainerStarted","Data":"6d67fe5375d4de22f3c8724c9867384596b0df5515b698e7d6440226ec1a0d64"} Jun 11 00:04:04.932807 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.932753 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" event={"ID":"b8763ade-72d9-4ab0-90c7-e1bda25649e1","Type":"ContainerStarted","Data":"c36abbc35145b05581ddf1e5c873e08cf5a0f75febcfeaa5e8fd7df81b203097"} Jun 11 00:04:04.946066 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:04.946018 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-8krf9" podStartSLOduration=0.946003512 podStartE2EDuration="946.003512ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:04.945957859 +0000 UTC m=+175.980334427" watchObservedRunningTime="2026-06-11 00:04:04.946003512 +0000 UTC m=+175.980380066" Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:05.778534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:05.778608 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:05.778635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.778713 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.778755 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.778796 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:07.778775125 +0000 UTC m=+178.813151669 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.778817 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:07.778807048 +0000 UTC m=+178.813183586 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:05.778885 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.778856 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:07.778840557 +0000 UTC m=+178.813217096 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:05.879246 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:05.879201 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:05.879506 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.879488 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:05.879596 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.879512 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:05.879596 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:05.879579 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:07.879558363 +0000 UTC m=+178.913934918 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:06.941869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:06.941807 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" event={"ID":"d65cc772-f31f-4119-aa4b-7aa62a6fd0d7","Type":"ContainerStarted","Data":"7f021747ebbbaf3ccaf7807ee905ec8b38b7f921b8751730cdd6088caa99b56e"} Jun 11 00:04:06.956790 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:06.956727 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-whxpm" podStartSLOduration=1.516359074 podStartE2EDuration="2.956709206s" totalImagesPullingTime="1.440350132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:06.955860057 +0000 UTC m=+177.990236614" watchObservedRunningTime="2026-06-11 00:04:06.956709206 +0000 UTC m=+177.991085759" Jun 11 00:04:07.796384 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.796299 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:07.796384 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.796351 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:07.796384 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.796376 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:07.796659 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.796496 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:07.796659 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.796523 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:07.796659 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.796577 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:11.796555799 +0000 UTC m=+182.830932354 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:07.796659 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.796598 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:11.796588412 +0000 UTC m=+182.830964948 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:07.796659 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.796613 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:11.796605173 +0000 UTC m=+182.830981705 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:07.897178 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.897132 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:07.897355 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.897267 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:07.897355 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.897288 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:07.897481 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:07.897360 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:11.8973399 +0000 UTC m=+182.931716450 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:07.947022 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.946980 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" event={"ID":"5a680d33-a66f-439b-82ea-15083c272cc4","Type":"ContainerStarted","Data":"5fe640584e667b6679489399ff8a375c18580ff85a5f58d24d3b01c583766a5b"} Jun 11 00:04:07.962381 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:07.962323 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" podStartSLOduration=1.154381036 podStartE2EDuration="3.962306974s" totalImagesPullingTime="2.807925938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:07.960952445 +0000 UTC m=+178.995328998" watchObservedRunningTime="2026-06-11 00:04:07.962306974 +0000 UTC m=+178.996683531" Jun 11 00:04:09.954659 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:09.954624 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" event={"ID":"7a03c9cf-7fae-4c21-a113-55ef4a16988c","Type":"ContainerStarted","Data":"e53c84ccc46593cee26060bdd331a18ac51891d966dff2ae1751f7382eb5ee4b"} Jun 11 00:04:09.955084 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:09.954853 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:09.956612 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:09.956589 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:04:09.970074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:09.970036 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" podStartSLOduration=1.499998258 podStartE2EDuration="5.970024573s" totalImagesPullingTime="4.470026315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:09.968510847 +0000 UTC m=+181.002887412" watchObservedRunningTime="2026-06-11 00:04:09.970024573 +0000 UTC m=+181.004401127" Jun 11 00:04:10.993626 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:10.993599 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xr57_5028d8be-d56a-4c7a-a01e-17f5579913e4/dns-node-resolver/0.log" Jun 11 00:04:11.828936 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:11.828900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:11.828936 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:11.828945 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:11.828963 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.829054 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.829054 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.829087 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:19.829066951 +0000 UTC m=+190.863443483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.829111 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:19.82910131 +0000 UTC m=+190.863477843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:11.829183 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.829122 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:19.829116622 +0000 UTC m=+190.863493154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:11.930245 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.930211 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:11.930245 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.930240 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:11.930245 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:11.930207 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:11.930487 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:11.930289 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:19.930276021 +0000 UTC m=+190.964652552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:12.593730 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:12.593701 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w69dp_c8df0dcc-e346-46ed-ac90-89794ce063c4/node-ca/0.log" Jun 11 00:04:13.193820 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:13.193788 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6h42_fcd43112-182d-4122-a6c3-73cab83ce955/serve-healthcheck-canary/0.log" Jun 11 00:04:19.891092 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:19.891030 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:19.891108 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:19.891139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.891179 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.891244 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:04:35.891225785 +0000 UTC m=+206.925602320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.891303 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:35.89128301 +0000 UTC m=+206.925659561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.891307 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:19.891571 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.891342 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:04:35.891332956 +0000 UTC m=+206.925709488 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:19.992411 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:19.992374 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:19.992621 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.992541 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:19.992621 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.992562 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:19.992745 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:19.992628 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:04:35.992608201 +0000 UTC m=+207.026984746 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:22.453602 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.453565 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-vq5zh"] Jun 11 00:04:22.456514 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.456491 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.458741 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.458710 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 00:04:22.458741 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.458737 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 00:04:22.459136 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.459113 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 00:04:22.459791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.459770 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cvw88\"" Jun 11 00:04:22.459881 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.459771 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 00:04:22.465738 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.465717 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vq5zh"] Jun 11 00:04:22.511852 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.511812 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7q2j9\" (UniqueName: \"kubernetes.io/projected/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-api-access-7q2j9\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.511852 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.511853 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.512098 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.511889 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daf6caa9-58ed-4004-9322-5db2c868b6fa-data-volume\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.512098 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.511968 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.512098 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.512070 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daf6caa9-58ed-4004-9322-5db2c868b6fa-crio-socket\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613200 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613157 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613359 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613218 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daf6caa9-58ed-4004-9322-5db2c868b6fa-data-volume\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613359 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613245 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613359 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:22.613336 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:22.613544 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:22.613459 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:23.113411612 +0000 UTC m=+194.147788145 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:22.613618 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613546 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daf6caa9-58ed-4004-9322-5db2c868b6fa-crio-socket\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613618 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613582 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7q2j9\" (UniqueName: \"kubernetes.io/projected/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-api-access-7q2j9\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613706 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613664 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/daf6caa9-58ed-4004-9322-5db2c868b6fa-crio-socket\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613752 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613688 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/daf6caa9-58ed-4004-9322-5db2c868b6fa-data-volume\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.613867 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.613848 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:22.621572 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:22.621548 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7q2j9\" (UniqueName: \"kubernetes.io/projected/daf6caa9-58ed-4004-9322-5db2c868b6fa-kube-api-access-7q2j9\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:23.118278 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:23.118230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:23.118489 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:23.118383 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:23.118489 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:23.118467 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:24.118450615 +0000 UTC m=+195.152827167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:24.126834 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:24.126777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:24.127317 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:24.126955 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:24.127317 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:24.127045 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:26.12702306 +0000 UTC m=+197.161399609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:26.144542 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:26.144494 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:26.144942 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:26.144647 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:26.144942 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:26.144716 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:30.144700895 +0000 UTC m=+201.179077428 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:30.180301 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:30.180262 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:30.180703 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:30.180452 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:30.180703 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:30.180550 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:38.180533054 +0000 UTC m=+209.214909586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:35.926906 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:35.926873 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:35.926906 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:35.926910 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:35.927016 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:35.927050 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:05:07.927028068 +0000 UTC m=+238.961404604 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : configmap references non-existent config key: service-ca.crt Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:35.927098 2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:35.927104 2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:35.927155 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls podName:de7084ea-54d2-42ad-bc19-89702fad376f nodeName:}" failed. No retries permitted until 2026-06-11 00:05:07.927143873 +0000 UTC m=+238.961520406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-rvjpt" (UID: "de7084ea-54d2-42ad-bc19-89702fad376f") : secret "cluster-monitoring-operator-tls" not found Jun 11 00:04:35.927417 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:35.927178 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs podName:1b4dbda6-d4f7-43b7-99d6-de9677adb2b3 nodeName:}" failed. No retries permitted until 2026-06-11 00:05:07.927161836 +0000 UTC m=+238.961538367 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs") pod "router-default-6f698f98d7-6trdv" (UID: "1b4dbda6-d4f7-43b7-99d6-de9677adb2b3") : secret "router-metrics-certs-default" not found Jun 11 00:04:36.027818 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:36.027775 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") pod \"image-registry-9c8f4bc89-2ghd4\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:36.028004 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:36.027914 2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 00:04:36.028004 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:36.027930 2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-9c8f4bc89-2ghd4: secret "image-registry-tls" not found Jun 11 00:04:36.028004 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:36.027990 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls podName:e3b7c003-ac3f-46f9-9ce5-3438f83957ae nodeName:}" failed. No retries permitted until 2026-06-11 00:05:08.027972276 +0000 UTC m=+239.062348823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls") pod "image-registry-9c8f4bc89-2ghd4" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae") : secret "image-registry-tls" not found Jun 11 00:04:38.247640 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:38.247599 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:38.248014 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:38.247759 2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 00:04:38.248014 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:38.247828 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls podName:daf6caa9-58ed-4004-9322-5db2c868b6fa nodeName:}" failed. No retries permitted until 2026-06-11 00:04:54.24781246 +0000 UTC m=+225.282188992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls") pod "insights-runtime-extractor-vq5zh" (UID: "daf6caa9-58ed-4004-9322-5db2c868b6fa") : secret "insights-runtime-extractor-tls" not found Jun 11 00:04:54.286632 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:54.286588 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:54.288922 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:54.288900 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/daf6caa9-58ed-4004-9322-5db2c868b6fa-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-vq5zh\" (UID: \"daf6caa9-58ed-4004-9322-5db2c868b6fa\") " pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:54.565712 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:54.565603 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-vq5zh" Jun 11 00:04:54.688363 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:54.688319 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-vq5zh"] Jun 11 00:04:54.690853 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:54.690828 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf6caa9_58ed_4004_9322_5db2c868b6fa.slice/crio-be3f8c960fb8969ca185ba339ff7dffe27c555c8ef52c60637fe7a8308deb50d WatchSource:0}: Error finding container be3f8c960fb8969ca185ba339ff7dffe27c555c8ef52c60637fe7a8308deb50d: Status 404 returned error can't find the container with id be3f8c960fb8969ca185ba339ff7dffe27c555c8ef52c60637fe7a8308deb50d Jun 11 00:04:55.041010 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.040971 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c8f4bc89-2ghd4"] Jun 11 00:04:55.041269 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:04:55.041246 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" podUID="e3b7c003-ac3f-46f9-9ce5-3438f83957ae" Jun 11 00:04:55.066636 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.066602 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7956f4f5c6-gx2p5"] Jun 11 00:04:55.068859 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.068842 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.079537 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.079511 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7956f4f5c6-gx2p5"] Jun 11 00:04:55.085441 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.085394 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vq5zh" event={"ID":"daf6caa9-58ed-4004-9322-5db2c868b6fa","Type":"ContainerStarted","Data":"bb151115cc52ff153dbe6c622f2c4bdf7ea3aaa7f41daf6b68628e59fb588610"} Jun 11 00:04:55.085555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.085466 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vq5zh" event={"ID":"daf6caa9-58ed-4004-9322-5db2c868b6fa","Type":"ContainerStarted","Data":"be3f8c960fb8969ca185ba339ff7dffe27c555c8ef52c60637fe7a8308deb50d"} Jun 11 00:04:55.085555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.085407 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:55.090285 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.090268 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:55.194591 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194554 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194591 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194593 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194649 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvnjn\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194688 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194733 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194786 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.194839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194815 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates\") pod \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\" (UID: \"e3b7c003-ac3f-46f9-9ce5-3438f83957ae\") " Jun 11 00:04:55.195079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194958 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-registry-certificates\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.194991 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-trusted-ca\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195023 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-bound-sa-token\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195219 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195099 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b018f5c-4541-470a-9441-86e229fe0a75-ca-trust-extracted\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195219 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195130 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-registry-tls\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195219 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195160 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-installation-pull-secrets\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195364 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195263 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 00:04:55.195440 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195373 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:04:55.195440 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195400 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-image-registry-private-configuration\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195549 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195462 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmqxx\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-kube-api-access-gmqxx\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.195549 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195535 2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-certificates\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.195661 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195553 2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-ca-trust-extracted\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.195661 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.195595 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:04:55.197305 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.197279 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn" (OuterVolumeSpecName: "kube-api-access-qvnjn") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "kube-api-access-qvnjn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:04:55.197555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.197524 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:04:55.197778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.197748 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:04:55.197970 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.197950 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e3b7c003-ac3f-46f9-9ce5-3438f83957ae" (UID: "e3b7c003-ac3f-46f9-9ce5-3438f83957ae"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:04:55.296091 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296056 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-bound-sa-token\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296139 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b018f5c-4541-470a-9441-86e229fe0a75-ca-trust-extracted\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296166 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-registry-tls\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296188 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-installation-pull-secrets\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296223 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-image-registry-private-configuration\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296257 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmqxx\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-kube-api-access-gmqxx\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296343 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-registry-certificates\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296372 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-trusted-ca\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296439 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-trusted-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296456 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvnjn\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-kube-api-access-qvnjn\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296478 2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-image-registry-private-configuration\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296492 2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-installation-pull-secrets\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.296527 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296506 2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-bound-sa-token\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:55.297071 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.296652 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/6b018f5c-4541-470a-9441-86e229fe0a75-ca-trust-extracted\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.297497 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.297471 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-registry-certificates\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.297616 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.297530 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6b018f5c-4541-470a-9441-86e229fe0a75-trusted-ca\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.299263 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.299216 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-image-registry-private-configuration\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.299263 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.299219 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-registry-tls\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.299263 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.299259 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/6b018f5c-4541-470a-9441-86e229fe0a75-installation-pull-secrets\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.305619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.305595 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-bound-sa-token\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.305786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.305771 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmqxx\" (UniqueName: \"kubernetes.io/projected/6b018f5c-4541-470a-9441-86e229fe0a75-kube-api-access-gmqxx\") pod \"image-registry-7956f4f5c6-gx2p5\" (UID: \"6b018f5c-4541-470a-9441-86e229fe0a75\") " pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.379143 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.379118 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-s695f\"" Jun 11 00:04:55.387623 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.387599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:55.514217 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:55.514095 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7956f4f5c6-gx2p5"] Jun 11 00:04:55.516492 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:04:55.516469 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b018f5c_4541_470a_9441_86e229fe0a75.slice/crio-0f96e19d2d26aa27db6efdafdbb43fe8b9814df344f80dea9d074887ca33870b WatchSource:0}: Error finding container 0f96e19d2d26aa27db6efdafdbb43fe8b9814df344f80dea9d074887ca33870b: Status 404 returned error can't find the container with id 0f96e19d2d26aa27db6efdafdbb43fe8b9814df344f80dea9d074887ca33870b Jun 11 00:04:56.090908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.090879 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" event={"ID":"6b018f5c-4541-470a-9441-86e229fe0a75","Type":"ContainerStarted","Data":"4e8d314ce9eb5b120869acaaa9a708cce03c86ba2ae11f6044f3d0a9a9f7874e"} Jun 11 00:04:56.091109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.090934 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" event={"ID":"6b018f5c-4541-470a-9441-86e229fe0a75","Type":"ContainerStarted","Data":"0f96e19d2d26aa27db6efdafdbb43fe8b9814df344f80dea9d074887ca33870b"} Jun 11 00:04:56.091109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.090963 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:04:56.092768 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.092729 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vq5zh" event={"ID":"daf6caa9-58ed-4004-9322-5db2c868b6fa","Type":"ContainerStarted","Data":"37173d955f66125ccaefb045bacd57642e4d23ae6e81ca25c0398e73cc9c97c8"} Jun 11 00:04:56.092768 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.092759 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-9c8f4bc89-2ghd4" Jun 11 00:04:56.109894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.109841 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podStartSLOduration=1.109823829 podStartE2EDuration="1.109823829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:56.108240625 +0000 UTC m=+227.142617178" watchObservedRunningTime="2026-06-11 00:04:56.109823829 +0000 UTC m=+227.144200383" Jun 11 00:04:56.131926 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.131894 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-9c8f4bc89-2ghd4"] Jun 11 00:04:56.135011 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.134980 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-9c8f4bc89-2ghd4"] Jun 11 00:04:56.306179 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:56.306148 2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e3b7c003-ac3f-46f9-9ce5-3438f83957ae-registry-tls\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:04:57.097832 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:57.097794 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-vq5zh" event={"ID":"daf6caa9-58ed-4004-9322-5db2c868b6fa","Type":"ContainerStarted","Data":"bcd4a3bfbc7a6e0a3de1699fc2b1c69d6d90f1548f264d871fdf344091d545ec"} Jun 11 00:04:57.114913 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:57.114870 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-vq5zh" podStartSLOduration=33.030826355 podStartE2EDuration="35.114856138s" totalImagesPullingTime="2.084029783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:04:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:04:57.113685391 +0000 UTC m=+228.148061955" watchObservedRunningTime="2026-06-11 00:04:57.114856138 +0000 UTC m=+228.149232692" Jun 11 00:04:57.422871 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:04:57.422830 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3b7c003-ac3f-46f9-9ce5-3438f83957ae" path="/var/lib/kubelet/pods/e3b7c003-ac3f-46f9-9ce5-3438f83957ae/volumes" Jun 11 00:05:01.376189 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.376152 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-2729h"] Jun 11 00:05:01.379176 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.379157 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:01.381956 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.381933 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 00:05:01.382081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.381935 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 00:05:01.382081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.382013 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kfnrt\"" Jun 11 00:05:01.392453 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.392415 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2729h"] Jun 11 00:05:01.440315 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.440283 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpldx\" (UniqueName: \"kubernetes.io/projected/283b979d-a041-4bcd-b126-f6b6ba7f8c87-kube-api-access-zpldx\") pod \"downloads-6657875f97-2729h\" (UID: \"283b979d-a041-4bcd-b126-f6b6ba7f8c87\") " pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:01.541032 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.541003 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpldx\" (UniqueName: \"kubernetes.io/projected/283b979d-a041-4bcd-b126-f6b6ba7f8c87-kube-api-access-zpldx\") pod \"downloads-6657875f97-2729h\" (UID: \"283b979d-a041-4bcd-b126-f6b6ba7f8c87\") " pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:01.548541 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.548510 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpldx\" (UniqueName: \"kubernetes.io/projected/283b979d-a041-4bcd-b126-f6b6ba7f8c87-kube-api-access-zpldx\") pod \"downloads-6657875f97-2729h\" (UID: \"283b979d-a041-4bcd-b126-f6b6ba7f8c87\") " pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:01.688909 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.688818 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:01.817122 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:01.816947 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2729h"] Jun 11 00:05:01.819656 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:01.819627 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod283b979d_a041_4bcd_b126_f6b6ba7f8c87.slice/crio-9fa3238b7af95f57c1f251956f5f0bdd2b4f39316735cd9a2852d8c1ceae01f8 WatchSource:0}: Error finding container 9fa3238b7af95f57c1f251956f5f0bdd2b4f39316735cd9a2852d8c1ceae01f8: Status 404 returned error can't find the container with id 9fa3238b7af95f57c1f251956f5f0bdd2b4f39316735cd9a2852d8c1ceae01f8 Jun 11 00:05:02.115770 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:02.115736 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2729h" event={"ID":"283b979d-a041-4bcd-b126-f6b6ba7f8c87","Type":"ContainerStarted","Data":"9fa3238b7af95f57c1f251956f5f0bdd2b4f39316735cd9a2852d8c1ceae01f8"} Jun 11 00:05:07.994155 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.994116 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:07.994155 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.994156 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:07.994684 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.994249 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:05:07.994908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.994889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-service-ca-bundle\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:07.996702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.996680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/de7084ea-54d2-42ad-bc19-89702fad376f-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-rvjpt\" (UID: \"de7084ea-54d2-42ad-bc19-89702fad376f\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:05:07.996763 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:07.996680 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1b4dbda6-d4f7-43b7-99d6-de9677adb2b3-metrics-certs\") pod \"router-default-6f698f98d7-6trdv\" (UID: \"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3\") " pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:08.269397 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.269373 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-wbcr2\"" Jun 11 00:05:08.274056 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.274038 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lj7t7\"" Jun 11 00:05:08.277753 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.277738 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" Jun 11 00:05:08.282960 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.282943 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:08.416415 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.416336 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f698f98d7-6trdv"] Jun 11 00:05:08.419828 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:08.419787 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b4dbda6_d4f7_43b7_99d6_de9677adb2b3.slice/crio-21140673d6d2b2b6a04f9346946951d13df1937cd977ed2d68805c1e5ed71882 WatchSource:0}: Error finding container 21140673d6d2b2b6a04f9346946951d13df1937cd977ed2d68805c1e5ed71882: Status 404 returned error can't find the container with id 21140673d6d2b2b6a04f9346946951d13df1937cd977ed2d68805c1e5ed71882 Jun 11 00:05:08.436042 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.436016 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt"] Jun 11 00:05:08.439566 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:08.439541 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde7084ea_54d2_42ad_bc19_89702fad376f.slice/crio-4da3a27a63ec03a9fde0cb135e81995d16182c38dfa27d854208d98883f5a19d WatchSource:0}: Error finding container 4da3a27a63ec03a9fde0cb135e81995d16182c38dfa27d854208d98883f5a19d: Status 404 returned error can't find the container with id 4da3a27a63ec03a9fde0cb135e81995d16182c38dfa27d854208d98883f5a19d Jun 11 00:05:08.893968 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.893930 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:05:08.896695 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.896672 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:08.899124 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.899104 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 00:05:08.899241 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.899121 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 00:05:08.899241 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.899230 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 00:05:08.899369 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.899240 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 00:05:08.900179 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.900164 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hxwwt\"" Jun 11 00:05:08.900269 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.900249 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 00:05:08.907700 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:08.907680 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001459 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001536 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001567 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001597 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001629 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zddvz\" (UniqueName: \"kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.001785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.001702 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103043 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103121 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103169 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103192 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103218 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zddvz\" (UniqueName: \"kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103944 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.103944 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103910 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.104094 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.103964 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.106249 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.106229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.106352 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.106260 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.110771 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.110750 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zddvz\" (UniqueName: \"kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz\") pod \"console-6fbff67648-5fvwl\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.140713 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.140681 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" event={"ID":"de7084ea-54d2-42ad-bc19-89702fad376f","Type":"ContainerStarted","Data":"4da3a27a63ec03a9fde0cb135e81995d16182c38dfa27d854208d98883f5a19d"} Jun 11 00:05:09.142074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.142049 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f698f98d7-6trdv" event={"ID":"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3","Type":"ContainerStarted","Data":"cb53bc0fad7aa7e16f8dbeb53b64dcdcf4f19da205d6c4bd368a6dd530e9a0de"} Jun 11 00:05:09.142173 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.142093 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f698f98d7-6trdv" event={"ID":"1b4dbda6-d4f7-43b7-99d6-de9677adb2b3","Type":"ContainerStarted","Data":"21140673d6d2b2b6a04f9346946951d13df1937cd977ed2d68805c1e5ed71882"} Jun 11 00:05:09.158730 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.158646 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f698f98d7-6trdv" podStartSLOduration=65.158632541 podStartE2EDuration="1m5.158632541s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:09.15793733 +0000 UTC m=+240.192313886" watchObservedRunningTime="2026-06-11 00:05:09.158632541 +0000 UTC m=+240.193009094" Jun 11 00:05:09.205338 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.205308 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:09.283572 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.283490 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:09.287028 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.286810 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:09.363460 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:09.363177 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:05:09.365744 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:09.365715 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b6a0be_b2e7_40b8_9329_956060bee941.slice/crio-3f31453d887f52061163cfe986c4d8eaf71f1d59ce1d4379749fe9c247d8fc92 WatchSource:0}: Error finding container 3f31453d887f52061163cfe986c4d8eaf71f1d59ce1d4379749fe9c247d8fc92: Status 404 returned error can't find the container with id 3f31453d887f52061163cfe986c4d8eaf71f1d59ce1d4379749fe9c247d8fc92 Jun 11 00:05:10.148399 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:10.148354 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbff67648-5fvwl" event={"ID":"e4b6a0be-b2e7-40b8-9329-956060bee941","Type":"ContainerStarted","Data":"3f31453d887f52061163cfe986c4d8eaf71f1d59ce1d4379749fe9c247d8fc92"} Jun 11 00:05:10.149162 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:10.148443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:10.150136 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:10.150112 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f698f98d7-6trdv" Jun 11 00:05:11.156624 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:11.156586 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" event={"ID":"de7084ea-54d2-42ad-bc19-89702fad376f","Type":"ContainerStarted","Data":"c45dafd0eaee79cfa46bc9e7802f398b74c83fdd47839eaa4df084db6440d528"} Jun 11 00:05:11.174042 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:11.173930 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-rvjpt" podStartSLOduration=65.16543732 podStartE2EDuration="1m7.173908018s" totalImagesPullingTime="2.008470698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:11.173674957 +0000 UTC m=+242.208051511" watchObservedRunningTime="2026-06-11 00:05:11.173908018 +0000 UTC m=+242.208284570" Jun 11 00:05:14.170596 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:14.170556 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbff67648-5fvwl" event={"ID":"e4b6a0be-b2e7-40b8-9329-956060bee941","Type":"ContainerStarted","Data":"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729"} Jun 11 00:05:14.185461 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:14.185401 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6fbff67648-5fvwl" podStartSLOduration=1.902179951 podStartE2EDuration="6.185383239s" totalImagesPullingTime="4.283203288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:14.185309286 +0000 UTC m=+245.219685841" watchObservedRunningTime="2026-06-11 00:05:14.185383239 +0000 UTC m=+245.219759771" Jun 11 00:05:15.392930 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:15.392887 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:15.393280 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:15.392939 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:16.584541 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:16.584514 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xr57_5028d8be-d56a-4c7a-a01e-17f5579913e4/dns-node-resolver/0.log" Jun 11 00:05:17.103635 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.103600 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:17.103812 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.103659 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:17.283816 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.283777 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:05:17.286222 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.286202 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.294686 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.294661 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 00:05:17.296252 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.296228 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:05:17.376159 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376073 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376159 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376140 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376159 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcnzw\" (UniqueName: \"kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376447 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376447 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376447 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376320 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.376447 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.376351 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477603 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477635 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477669 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477704 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477728 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcnzw\" (UniqueName: \"kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.477847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477755 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.478053 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.477861 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.478405 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.478355 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.478568 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.478404 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.478912 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.478892 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.478960 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.478906 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.480219 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.480198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.480302 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.480197 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.485220 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.485185 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcnzw\" (UniqueName: \"kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw\") pod \"console-5f69cd8d55-w7hzk\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:17.577379 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.577348 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7956f4f5c6-gx2p5_6b018f5c-4541-470a-9441-86e229fe0a75/registry/0.log" Jun 11 00:05:17.597233 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:17.597189 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:18.177644 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:18.177612 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w69dp_c8df0dcc-e346-46ed-ac90-89794ce063c4/node-ca/0.log" Jun 11 00:05:18.377615 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:18.377578 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log" Jun 11 00:05:18.777631 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:18.777593 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6h42_fcd43112-182d-4122-a6c3-73cab83ce955/serve-healthcheck-canary/0.log" Jun 11 00:05:19.206047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.205954 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:19.206047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.206026 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:05:19.207767 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.207740 2558 patch_prober.go:28] interesting pod/console-6fbff67648-5fvwl container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 11 00:05:19.207908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.207789 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6fbff67648-5fvwl" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 11 00:05:19.327735 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.327702 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf"] Jun 11 00:05:19.330583 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.330560 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.334024 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.334119 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.334369 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.335248 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-r2kvx"] Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.335467 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bmbsm\"" Jun 11 00:05:19.337163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.335731 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 00:05:19.339691 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.339669 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.342366 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.342337 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 00:05:19.342534 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.342515 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 00:05:19.342604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.342591 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-s5jxv\"" Jun 11 00:05:19.342813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.342794 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 00:05:19.343150 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.343122 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf"] Jun 11 00:05:19.394847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.394806 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.394856 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.394886 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-wtmp\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.394952 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d43d-15e5-4d44-b191-f329f80686a0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395031 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395062 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqvwl\" (UniqueName: \"kubernetes.io/projected/ece35185-ae3a-4962-85d6-f36719ca4761-kube-api-access-hqvwl\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395101 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-metrics-client-ca\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395131 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395163 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-sys\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395529 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395225 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395529 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395271 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395529 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395291 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-root\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.395529 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395389 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq5bd\" (UniqueName: \"kubernetes.io/projected/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-api-access-tq5bd\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.395529 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.395476 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-textfile\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496716 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496624 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-textfile\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496716 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496724 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496752 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-wtmp\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496777 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d43d-15e5-4d44-b191-f329f80686a0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496833 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496862 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqvwl\" (UniqueName: \"kubernetes.io/projected/ece35185-ae3a-4962-85d6-f36719ca4761-kube-api-access-hqvwl\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496903 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-metrics-client-ca\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.496943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496932 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496961 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496971 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-wtmp\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.496989 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-sys\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497039 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-sys\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497041 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497064 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-textfile\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497088 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497117 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-root\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497146 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tq5bd\" (UniqueName: \"kubernetes.io/projected/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-api-access-tq5bd\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.497360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-accelerators-collector-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.497863 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497554 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b2e8d43d-15e5-4d44-b191-f329f80686a0-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.497863 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:05:19.497558 2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 00:05:19.497863 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:05:19.497650 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls podName:ece35185-ae3a-4962-85d6-f36719ca4761 nodeName:}" failed. No retries permitted until 2026-06-11 00:05:19.997628273 +0000 UTC m=+251.032004808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls") pod "node-exporter-r2kvx" (UID: "ece35185-ae3a-4962-85d6-f36719ca4761") : secret "node-exporter-tls" not found Jun 11 00:05:19.497863 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497780 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.497863 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ece35185-ae3a-4962-85d6-f36719ca4761-root\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.498127 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.497879 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ece35185-ae3a-4962-85d6-f36719ca4761-metrics-client-ca\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.498127 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.498095 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.499911 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.499872 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.500056 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.499978 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.500124 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.500092 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.507178 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.507147 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq5bd\" (UniqueName: \"kubernetes.io/projected/b2e8d43d-15e5-4d44-b191-f329f80686a0-kube-api-access-tq5bd\") pod \"kube-state-metrics-57bbf8bfb5-sdpcf\" (UID: \"b2e8d43d-15e5-4d44-b191-f329f80686a0\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:19.508222 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.508194 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqvwl\" (UniqueName: \"kubernetes.io/projected/ece35185-ae3a-4962-85d6-f36719ca4761-kube-api-access-hqvwl\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:19.649887 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:19.649845 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" Jun 11 00:05:20.000718 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.000670 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:20.003154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.003127 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ece35185-ae3a-4962-85d6-f36719ca4761-node-exporter-tls\") pod \"node-exporter-r2kvx\" (UID: \"ece35185-ae3a-4962-85d6-f36719ca4761\") " pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:20.257504 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.257405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-r2kvx" Jun 11 00:05:20.387361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.387322 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 00:05:20.390720 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.390691 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.393094 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393071 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 11 00:05:20.393094 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393071 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 11 00:05:20.393348 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393330 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 11 00:05:20.393611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393454 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 11 00:05:20.393611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393462 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 11 00:05:20.393611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393597 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 11 00:05:20.394015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 11 00:05:20.394015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393964 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-x9wrr\"" Jun 11 00:05:20.394015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393983 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 11 00:05:20.394015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.393967 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 11 00:05:20.404243 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.404209 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 00:05:20.506900 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.506861 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.506912 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.506938 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.506993 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507021 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507047 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507076 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507068 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn4cr\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-kube-api-access-mn4cr\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507094 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-out\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507182 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507260 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-web-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507389 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507354 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.507692 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.507410 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.607921 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.607878 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.607931 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-out\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.607964 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608021 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-web-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608045 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608109 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608086 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608127 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608159 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608226 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608275 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.608371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.608332 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn4cr\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-kube-api-access-mn4cr\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.609881 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.609334 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.609881 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.609656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.609881 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:05:20.609807 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle podName:deda78b5-de74-4b23-8759-80f77fb6ab1f nodeName:}" failed. No retries permitted until 2026-06-11 00:05:21.109787992 +0000 UTC m=+252.144164547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "deda78b5-de74-4b23-8759-80f77fb6ab1f") : configmap references non-existent config key: ca-bundle.crt Jun 11 00:05:20.611324 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.611276 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-out\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.612246 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.612221 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.613061 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.613005 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.613982 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.613961 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-web-config\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.614699 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.614675 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.615203 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.615175 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-config-volume\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.615604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.615578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.615698 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.615666 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.616264 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.616241 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/deda78b5-de74-4b23-8759-80f77fb6ab1f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:20.617226 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:20.617198 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn4cr\" (UniqueName: \"kubernetes.io/projected/deda78b5-de74-4b23-8759-80f77fb6ab1f-kube-api-access-mn4cr\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:21.113054 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.113012 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:21.114079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.114055 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/deda78b5-de74-4b23-8759-80f77fb6ab1f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"deda78b5-de74-4b23-8759-80f77fb6ab1f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:21.214278 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.214237 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:05:21.217096 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.217062 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a96e0628-ae65-4495-a644-1d920aae686d-metrics-certs\") pod \"network-metrics-daemon-28x5s\" (UID: \"a96e0628-ae65-4495-a644-1d920aae686d\") " pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:05:21.303531 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.303492 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 11 00:05:21.322036 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.321994 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-75lrw\"" Jun 11 00:05:21.330229 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:21.330190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-28x5s" Jun 11 00:05:24.114482 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:24.114449 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:05:24.500631 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:24.497256 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece35185_ae3a_4962_85d6_f36719ca4761.slice/crio-c5ba02ad22233d054a56fabeee288331a527dd43bf2607026fdfc2d97d0df09c WatchSource:0}: Error finding container c5ba02ad22233d054a56fabeee288331a527dd43bf2607026fdfc2d97d0df09c: Status 404 returned error can't find the container with id c5ba02ad22233d054a56fabeee288331a527dd43bf2607026fdfc2d97d0df09c Jun 11 00:05:24.689991 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:24.689954 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 11 00:05:24.694069 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:24.694038 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeda78b5_de74_4b23_8759_80f77fb6ab1f.slice/crio-8f516ad7cacf2cad97042b91d2aa700d05567da58e16ade1baea6a52bdb2fb1e WatchSource:0}: Error finding container 8f516ad7cacf2cad97042b91d2aa700d05567da58e16ade1baea6a52bdb2fb1e: Status 404 returned error can't find the container with id 8f516ad7cacf2cad97042b91d2aa700d05567da58e16ade1baea6a52bdb2fb1e Jun 11 00:05:24.732772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:24.732744 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-28x5s"] Jun 11 00:05:24.735090 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:24.735065 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96e0628_ae65_4495_a644_1d920aae686d.slice/crio-87b8b2415050366500bba21efe3bfaffe43fab8c00068030c9364eb7ff625514 WatchSource:0}: Error finding container 87b8b2415050366500bba21efe3bfaffe43fab8c00068030c9364eb7ff625514: Status 404 returned error can't find the container with id 87b8b2415050366500bba21efe3bfaffe43fab8c00068030c9364eb7ff625514 Jun 11 00:05:24.906549 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:24.906519 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:05:24.909882 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:24.909853 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02cece17_e013_4690_8e6e_1db8c2d14d82.slice/crio-0cb275cc67149e687084f1e9cb0d6a9434ea33281e5c03d4254c3a20c379ed9d WatchSource:0}: Error finding container 0cb275cc67149e687084f1e9cb0d6a9434ea33281e5c03d4254c3a20c379ed9d: Status 404 returned error can't find the container with id 0cb275cc67149e687084f1e9cb0d6a9434ea33281e5c03d4254c3a20c379ed9d Jun 11 00:05:24.910715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:24.910681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf"] Jun 11 00:05:24.913566 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:24.913536 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e8d43d_15e5_4d44_b191_f329f80686a0.slice/crio-5cd039db169f2b9a4bbdb9fe1e515d3e0b5b06382a9157b98c3e98b73d2f8e0d WatchSource:0}: Error finding container 5cd039db169f2b9a4bbdb9fe1e515d3e0b5b06382a9157b98c3e98b73d2f8e0d: Status 404 returned error can't find the container with id 5cd039db169f2b9a4bbdb9fe1e515d3e0b5b06382a9157b98c3e98b73d2f8e0d Jun 11 00:05:25.212792 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.212701 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28x5s" event={"ID":"a96e0628-ae65-4495-a644-1d920aae686d","Type":"ContainerStarted","Data":"87b8b2415050366500bba21efe3bfaffe43fab8c00068030c9364eb7ff625514"} Jun 11 00:05:25.215057 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.215021 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" event={"ID":"b2e8d43d-15e5-4d44-b191-f329f80686a0","Type":"ContainerStarted","Data":"5cd039db169f2b9a4bbdb9fe1e515d3e0b5b06382a9157b98c3e98b73d2f8e0d"} Jun 11 00:05:25.217812 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.217505 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2729h" event={"ID":"283b979d-a041-4bcd-b126-f6b6ba7f8c87","Type":"ContainerStarted","Data":"20824fb67ea81dd886c24ea3388feb5eb013730d3abc44691a54309f48a1f5b4"} Jun 11 00:05:25.218024 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.218004 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:25.222030 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.222000 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2kvx" event={"ID":"ece35185-ae3a-4962-85d6-f36719ca4761","Type":"ContainerStarted","Data":"c5ba02ad22233d054a56fabeee288331a527dd43bf2607026fdfc2d97d0df09c"} Jun 11 00:05:25.225531 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.225448 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f69cd8d55-w7hzk" event={"ID":"02cece17-e013-4690-8e6e-1db8c2d14d82","Type":"ContainerStarted","Data":"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395"} Jun 11 00:05:25.225702 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.225684 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f69cd8d55-w7hzk" event={"ID":"02cece17-e013-4690-8e6e-1db8c2d14d82","Type":"ContainerStarted","Data":"0cb275cc67149e687084f1e9cb0d6a9434ea33281e5c03d4254c3a20c379ed9d"} Jun 11 00:05:25.227148 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.227103 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-2729h" Jun 11 00:05:25.227653 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.227569 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"8f516ad7cacf2cad97042b91d2aa700d05567da58e16ade1baea6a52bdb2fb1e"} Jun 11 00:05:25.231578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.230730 2558 generic.go:356] "Generic (PLEG): container finished" podID="5a680d33-a66f-439b-82ea-15083c272cc4" containerID="5fe640584e667b6679489399ff8a375c18580ff85a5f58d24d3b01c583766a5b" exitCode=0 Jun 11 00:05:25.231578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.230768 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" event={"ID":"5a680d33-a66f-439b-82ea-15083c272cc4","Type":"ContainerDied","Data":"5fe640584e667b6679489399ff8a375c18580ff85a5f58d24d3b01c583766a5b"} Jun 11 00:05:25.231578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.231070 2558 scope.go:117] "RemoveContainer" containerID="5fe640584e667b6679489399ff8a375c18580ff85a5f58d24d3b01c583766a5b" Jun 11 00:05:25.239003 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.236730 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-2729h" podStartSLOduration=1.502294029 podStartE2EDuration="24.236711699s" totalImagesPullingTime="22.73441767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:05:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:25.234510293 +0000 UTC m=+256.268886848" watchObservedRunningTime="2026-06-11 00:05:25.236711699 +0000 UTC m=+256.271088254" Jun 11 00:05:25.293983 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.293557 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f69cd8d55-w7hzk" podStartSLOduration=8.293537217 podStartE2EDuration="8.293537217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:05:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:25.291750652 +0000 UTC m=+256.326127232" watchObservedRunningTime="2026-06-11 00:05:25.293537217 +0000 UTC m=+256.327913772" Jun 11 00:05:25.395654 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.395187 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:25.395654 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:25.395252 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:26.239215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:26.238370 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-fl989" event={"ID":"5a680d33-a66f-439b-82ea-15083c272cc4","Type":"ContainerStarted","Data":"434b97a9bd5a69cc3a1741725292e7b6298dfb1cc92de2d8dac2d08b45fced84"} Jun 11 00:05:27.104396 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.104046 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:27.104396 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.104115 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:27.597772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.597732 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:27.598215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.597817 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:05:27.599308 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.599285 2558 patch_prober.go:28] interesting pod/console-5f69cd8d55-w7hzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 00:05:27.599455 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:27.599326 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f69cd8d55-w7hzk" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 00:05:28.271805 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:28.271534 2558 generic.go:356] "Generic (PLEG): container finished" podID="deda78b5-de74-4b23-8759-80f77fb6ab1f" containerID="39b59de7fb606ec270ee27c471b79b751a4a9c35b5660790f1c51aae57dbe9c9" exitCode=0 Jun 11 00:05:28.273755 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:28.272677 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerDied","Data":"39b59de7fb606ec270ee27c471b79b751a4a9c35b5660790f1c51aae57dbe9c9"} Jun 11 00:05:28.282465 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:28.281751 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28x5s" event={"ID":"a96e0628-ae65-4495-a644-1d920aae686d","Type":"ContainerStarted","Data":"aa051626ab6ecbf45e6c4385a57ad6ef9319ed0c183a494ff83ea59987ffa949"} Jun 11 00:05:28.287878 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:28.287774 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" event={"ID":"b2e8d43d-15e5-4d44-b191-f329f80686a0","Type":"ContainerStarted","Data":"57c4af3b59183ebd22ae829ada926271672afe9f72f0901f6ad5e43a46e33882"} Jun 11 00:05:28.304467 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:28.301921 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2kvx" event={"ID":"ece35185-ae3a-4962-85d6-f36719ca4761","Type":"ContainerStarted","Data":"2a254cf05db47c4c98045377b22218cf0c8c8f86c4085a3b90c9c9436db4ead6"} Jun 11 00:05:29.308744 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.308202 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-28x5s" event={"ID":"a96e0628-ae65-4495-a644-1d920aae686d","Type":"ContainerStarted","Data":"73673abc5a986377afe021b9ee619cd8debff10de714d6e4bdbab3fe7c146da1"} Jun 11 00:05:29.310677 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.310645 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" event={"ID":"b2e8d43d-15e5-4d44-b191-f329f80686a0","Type":"ContainerStarted","Data":"ef49cefc0b112018a478cdb46876a23e962c7e31dde4444fc4abdc0a1404e8ae"} Jun 11 00:05:29.310822 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.310721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" event={"ID":"b2e8d43d-15e5-4d44-b191-f329f80686a0","Type":"ContainerStarted","Data":"46865251d441848033726db7edc8c27ded133efba9fa8ccf11a0d1247734adfb"} Jun 11 00:05:29.312566 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.312533 2558 generic.go:356] "Generic (PLEG): container finished" podID="ece35185-ae3a-4962-85d6-f36719ca4761" containerID="2a254cf05db47c4c98045377b22218cf0c8c8f86c4085a3b90c9c9436db4ead6" exitCode=0 Jun 11 00:05:29.312701 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.312609 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2kvx" event={"ID":"ece35185-ae3a-4962-85d6-f36719ca4761","Type":"ContainerDied","Data":"2a254cf05db47c4c98045377b22218cf0c8c8f86c4085a3b90c9c9436db4ead6"} Jun 11 00:05:29.324993 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.324932 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-28x5s" podStartSLOduration=257.108363171 podStartE2EDuration="4m20.324915262s" totalImagesPullingTime="3.216552091s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:29.32458357 +0000 UTC m=+260.358960123" watchObservedRunningTime="2026-06-11 00:05:29.324915262 +0000 UTC m=+260.359291815" Jun 11 00:05:29.341583 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:29.341522 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-sdpcf" podStartSLOduration=7.2994678969999995 podStartE2EDuration="10.341502012s" totalImagesPullingTime="3.042034115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:29.339850378 +0000 UTC m=+260.374226932" watchObservedRunningTime="2026-06-11 00:05:29.341502012 +0000 UTC m=+260.375878567" Jun 11 00:05:30.322470 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:30.322435 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2kvx" event={"ID":"ece35185-ae3a-4962-85d6-f36719ca4761","Type":"ContainerStarted","Data":"69d6652edb763d2d84453237f9a616decacd0bcc682cb029c6b692ba7fe13902"} Jun 11 00:05:30.323625 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:30.323600 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-r2kvx" event={"ID":"ece35185-ae3a-4962-85d6-f36719ca4761","Type":"ContainerStarted","Data":"d751ce886da56a072fe5aac2661425385a441f4a5fa77010157dfd4a0b0a9b32"} Jun 11 00:05:30.341800 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:30.341740 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-r2kvx" podStartSLOduration=7.704179742 podStartE2EDuration="11.341719086s" totalImagesPullingTime="3.450857701s" totalInitContainerRuntime="186.681643ms" isStatefulPod=true podCreationTimestamp="2026-06-11 00:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:30.339376149 +0000 UTC m=+261.373752705" watchObservedRunningTime="2026-06-11 00:05:30.341719086 +0000 UTC m=+261.376095640" Jun 11 00:05:35.392013 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.391977 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:35.392498 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.392029 2558 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:35.392498 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.392067 2558 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:05:35.392649 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.392610 2558 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"4e8d314ce9eb5b120869acaaa9a708cce03c86ba2ae11f6044f3d0a9a9f7874e"} pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" containerMessage="Container registry failed liveness probe, will be restarted" Jun 11 00:05:35.396286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.396262 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:35.396400 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:35.396316 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:36.346775 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:36.346747 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"4f71f7c3b62764d7fc79c5d1b496b0626dc7a0f4db458966799792a0b6088e46"} Jun 11 00:05:36.346870 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:36.346811 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"206cc40846aedf9ffe91c4e49d9723782677d0b2b40cb632252f7f90715b7153"} Jun 11 00:05:36.346870 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:36.346836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"bea5b4c3b1dd91bba2b46f0cc7c56f45f78fe5acfa1d58bbaaa404c34c869c3d"} Jun 11 00:05:36.346870 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:36.346862 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"0a0ff84c547e2d4c54ee37a08596298fa0ea1e7b5a7f557b68041919cb02fd3a"} Jun 11 00:05:37.358250 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:37.358216 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"0426faa79e11e15d37bfa60ba04556e65377a8d730592a656034804bb553c57b"} Jun 11 00:05:37.598590 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:37.598553 2558 patch_prober.go:28] interesting pod/console-5f69cd8d55-w7hzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 00:05:37.598755 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:37.598607 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f69cd8d55-w7hzk" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 00:05:38.365988 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:38.365953 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"deda78b5-de74-4b23-8759-80f77fb6ab1f","Type":"ContainerStarted","Data":"799cd6ba6632f0151d0291d4415492e0085d854ee1931d6e943bccd1d07b733b"} Jun 11 00:05:38.390216 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:38.390164 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=6.327974612 podStartE2EDuration="18.390146857s" totalImagesPullingTime="12.050072865s" totalInitContainerRuntime="12.09938ms" isStatefulPod=false podCreationTimestamp="2026-06-11 00:05:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:38.388286367 +0000 UTC m=+269.422662931" watchObservedRunningTime="2026-06-11 00:05:38.390146857 +0000 UTC m=+269.424523411" Jun 11 00:05:45.396954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:45.396915 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:45.397416 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:45.396976 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:47.598443 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:47.598399 2558 patch_prober.go:28] interesting pod/console-5f69cd8d55-w7hzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 00:05:47.598912 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:47.598487 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f69cd8d55-w7hzk" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 00:05:49.136163 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:49.136094 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6fbff67648-5fvwl" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerName="console" containerID="cri-o://73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729" gracePeriod=15 Jun 11 00:05:50.887833 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:05:50.887785 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-xblr4" podUID="8626ce16-c5fb-4255-93bd-062aa41817c2" Jun 11 00:05:51.415959 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:51.415929 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblr4" Jun 11 00:05:54.831754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:54.831715 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:05:54.834048 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:54.834028 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8626ce16-c5fb-4255-93bd-062aa41817c2-metrics-tls\") pod \"dns-default-xblr4\" (UID: \"8626ce16-c5fb-4255-93bd-062aa41817c2\") " pod="openshift-dns/dns-default-xblr4" Jun 11 00:05:55.019917 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.019886 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7rjx2\"" Jun 11 00:05:55.027958 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.027922 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xblr4" Jun 11 00:05:55.196512 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.196290 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xblr4"] Jun 11 00:05:55.198562 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:05:55.198531 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8626ce16_c5fb_4255_93bd_062aa41817c2.slice/crio-bc9253aca491189d090707cbfd4e5a373834d33afc8382ee42b23015befd2b08 WatchSource:0}: Error finding container bc9253aca491189d090707cbfd4e5a373834d33afc8382ee42b23015befd2b08: Status 404 returned error can't find the container with id bc9253aca491189d090707cbfd4e5a373834d33afc8382ee42b23015befd2b08 Jun 11 00:05:55.396614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.396539 2558 patch_prober.go:28] interesting pod/image-registry-7956f4f5c6-gx2p5 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 00:05:55.396614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.396588 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:05:55.430905 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:55.430873 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblr4" event={"ID":"8626ce16-c5fb-4255-93bd-062aa41817c2","Type":"ContainerStarted","Data":"bc9253aca491189d090707cbfd4e5a373834d33afc8382ee42b23015befd2b08"} Jun 11 00:05:57.441108 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.441073 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblr4" event={"ID":"8626ce16-c5fb-4255-93bd-062aa41817c2","Type":"ContainerStarted","Data":"b30a6996e1a31ae2f02210ec1fd81508f5bb9b89422d010867caa3cf0090246a"} Jun 11 00:05:57.441557 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.441127 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xblr4" event={"ID":"8626ce16-c5fb-4255-93bd-062aa41817c2","Type":"ContainerStarted","Data":"58aeca85e448b45e27faf5aa9ac006886eeb041ec61dd5df053e7fa492ebd1df"} Jun 11 00:05:57.441557 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.441291 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xblr4" Jun 11 00:05:57.457018 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.456968 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xblr4" podStartSLOduration=251.511864351 podStartE2EDuration="4m13.456951938s" totalImagesPullingTime="1.945087587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:01:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:05:57.456035457 +0000 UTC m=+288.490412012" watchObservedRunningTime="2026-06-11 00:05:57.456951938 +0000 UTC m=+288.491328491" Jun 11 00:05:57.598263 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.598225 2558 patch_prober.go:28] interesting pod/console-5f69cd8d55-w7hzk container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" start-of-body= Jun 11 00:05:57.598444 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:05:57.598279 2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5f69cd8d55-w7hzk" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" probeResult="failure" output="Get \"https://10.133.0.19:8443/health\": dial tcp 10.133.0.19:8443: connect: connection refused" Jun 11 00:06:00.411720 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:00.411680 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" podUID="6b018f5c-4541-470a-9441-86e229fe0a75" containerName="registry" containerID="cri-o://4e8d314ce9eb5b120869acaaa9a708cce03c86ba2ae11f6044f3d0a9a9f7874e" gracePeriod=30 Jun 11 00:06:02.463286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:02.463245 2558 generic.go:356] "Generic (PLEG): container finished" podID="6b018f5c-4541-470a-9441-86e229fe0a75" containerID="4e8d314ce9eb5b120869acaaa9a708cce03c86ba2ae11f6044f3d0a9a9f7874e" exitCode=0 Jun 11 00:06:02.463685 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:02.463318 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" event={"ID":"6b018f5c-4541-470a-9441-86e229fe0a75","Type":"ContainerDied","Data":"4e8d314ce9eb5b120869acaaa9a708cce03c86ba2ae11f6044f3d0a9a9f7874e"} Jun 11 00:06:02.463685 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:02.463397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" event={"ID":"6b018f5c-4541-470a-9441-86e229fe0a75","Type":"ContainerStarted","Data":"4c08dabc174f4b7abf660735d9ec8e37b3e7fd58a213b689c3fa2ddea60e4b7b"} Jun 11 00:06:02.463685 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:02.463568 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:06:04.108090 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.108063 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:06:04.210555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210461 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.210555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210533 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zddvz\" (UniqueName: \"kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.210778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210579 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.210778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210607 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.210778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210721 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.210778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.210764 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca\") pod \"e4b6a0be-b2e7-40b8-9329-956060bee941\" (UID: \"e4b6a0be-b2e7-40b8-9329-956060bee941\") " Jun 11 00:06:04.211121 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.211070 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config" (OuterVolumeSpecName: "console-config") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:04.211121 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.211077 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:04.211299 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.211160 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca" (OuterVolumeSpecName: "service-ca") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:04.212897 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.212874 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:06:04.212990 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.212891 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz" (OuterVolumeSpecName: "kube-api-access-zddvz") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "kube-api-access-zddvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:06:04.212990 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.212922 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e4b6a0be-b2e7-40b8-9329-956060bee941" (UID: "e4b6a0be-b2e7-40b8-9329-956060bee941"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:06:04.311997 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.311957 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.311997 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.311989 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zddvz\" (UniqueName: \"kubernetes.io/projected/e4b6a0be-b2e7-40b8-9329-956060bee941-kube-api-access-zddvz\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.311997 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.311999 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.311997 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.312007 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e4b6a0be-b2e7-40b8-9329-956060bee941-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.312259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.312016 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.312259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.312026 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e4b6a0be-b2e7-40b8-9329-956060bee941-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:04.472578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.472494 2558 generic.go:356] "Generic (PLEG): container finished" podID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerID="73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729" exitCode=0 Jun 11 00:06:04.472578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.472533 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6fbff67648-5fvwl" Jun 11 00:06:04.472578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.472547 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbff67648-5fvwl" event={"ID":"e4b6a0be-b2e7-40b8-9329-956060bee941","Type":"ContainerDied","Data":"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729"} Jun 11 00:06:04.472795 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.472601 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6fbff67648-5fvwl" event={"ID":"e4b6a0be-b2e7-40b8-9329-956060bee941","Type":"ContainerDied","Data":"3f31453d887f52061163cfe986c4d8eaf71f1d59ce1d4379749fe9c247d8fc92"} Jun 11 00:06:04.472795 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.472632 2558 scope.go:117] "RemoveContainer" containerID="73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729" Jun 11 00:06:04.493220 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.493200 2558 scope.go:117] "RemoveContainer" containerID="73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729" Jun 11 00:06:04.493330 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.493202 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:06:04.493607 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:06:04.493586 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729\": container with ID starting with 73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729 not found: ID does not exist" containerID="73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729" Jun 11 00:06:04.493664 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.493616 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729"} err="failed to get container status \"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729\": rpc error: code = NotFound desc = could not find container \"73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729\": container with ID starting with 73b18a2269925ae43d429a6f587d263e415ee8794f872f1fab79f89ede023729 not found: ID does not exist" Jun 11 00:06:04.500872 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.500849 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6fbff67648-5fvwl"] Jun 11 00:06:04.521694 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:04.521663 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:06:05.424382 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:05.424350 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" path="/var/lib/kubelet/pods/e4b6a0be-b2e7-40b8-9329-956060bee941/volumes" Jun 11 00:06:07.447750 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:07.447721 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xblr4" Jun 11 00:06:09.371863 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.371837 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:06:09.372563 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.372543 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:06:09.381668 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.381651 2558 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 00:06:09.493996 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.493805 2558 generic.go:356] "Generic (PLEG): container finished" podID="7a03c9cf-7fae-4c21-a113-55ef4a16988c" containerID="e53c84ccc46593cee26060bdd331a18ac51891d966dff2ae1751f7382eb5ee4b" exitCode=1 Jun 11 00:06:09.493996 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.493848 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" event={"ID":"7a03c9cf-7fae-4c21-a113-55ef4a16988c","Type":"ContainerDied","Data":"e53c84ccc46593cee26060bdd331a18ac51891d966dff2ae1751f7382eb5ee4b"} Jun 11 00:06:09.583392 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.494174 2558 scope.go:117] "RemoveContainer" containerID="e53c84ccc46593cee26060bdd331a18ac51891d966dff2ae1751f7382eb5ee4b" Jun 11 00:06:09.955113 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:09.955073 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:06:10.500500 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:10.500463 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" event={"ID":"7a03c9cf-7fae-4c21-a113-55ef4a16988c","Type":"ContainerStarted","Data":"36b468ec5776a15e0832ee92ad0e82ea5126a13d571f7360179896264c29c2d2"} Jun 11 00:06:10.500952 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:10.500658 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:06:10.501259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:10.501241 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-f4fdccc96-v7qfc" Jun 11 00:06:23.472323 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:23.472294 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7956f4f5c6-gx2p5" Jun 11 00:06:29.541128 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.541057 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5f69cd8d55-w7hzk" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" containerID="cri-o://e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395" gracePeriod=15 Jun 11 00:06:29.775266 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.775239 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:06:29.944799 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.944711 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.944799 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.944762 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.944799 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.944789 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.945029 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.944906 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.945029 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.944998 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.945130 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945030 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcnzw\" (UniqueName: \"kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.945130 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945054 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert\") pod \"02cece17-e013-4690-8e6e-1db8c2d14d82\" (UID: \"02cece17-e013-4690-8e6e-1db8c2d14d82\") " Jun 11 00:06:29.945243 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945215 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:29.945243 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945227 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:29.945360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945341 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca" (OuterVolumeSpecName: "service-ca") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:29.945444 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945388 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:29.945444 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945402 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:29.945539 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.945452 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config" (OuterVolumeSpecName: "console-config") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:06:29.947028 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.946996 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw" (OuterVolumeSpecName: "kube-api-access-wcnzw") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "kube-api-access-wcnzw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:06:29.947178 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.947095 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:06:29.947178 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:29.947108 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "02cece17-e013-4690-8e6e-1db8c2d14d82" (UID: "02cece17-e013-4690-8e6e-1db8c2d14d82"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:06:30.046394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.046358 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:30.046394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.046387 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/02cece17-e013-4690-8e6e-1db8c2d14d82-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:30.046394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.046397 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcnzw\" (UniqueName: \"kubernetes.io/projected/02cece17-e013-4690-8e6e-1db8c2d14d82-kube-api-access-wcnzw\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:30.046629 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.046405 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:30.046629 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.046414 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/02cece17-e013-4690-8e6e-1db8c2d14d82-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:06:30.575653 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.575612 2558 generic.go:356] "Generic (PLEG): container finished" podID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerID="e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395" exitCode=0 Jun 11 00:06:30.575653 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.575656 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f69cd8d55-w7hzk" Jun 11 00:06:30.576176 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.575699 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f69cd8d55-w7hzk" event={"ID":"02cece17-e013-4690-8e6e-1db8c2d14d82","Type":"ContainerDied","Data":"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395"} Jun 11 00:06:30.576176 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.575744 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f69cd8d55-w7hzk" event={"ID":"02cece17-e013-4690-8e6e-1db8c2d14d82","Type":"ContainerDied","Data":"0cb275cc67149e687084f1e9cb0d6a9434ea33281e5c03d4254c3a20c379ed9d"} Jun 11 00:06:30.576176 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.575763 2558 scope.go:117] "RemoveContainer" containerID="e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395" Jun 11 00:06:30.585979 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.585961 2558 scope.go:117] "RemoveContainer" containerID="e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395" Jun 11 00:06:30.586215 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:06:30.586198 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395\": container with ID starting with e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395 not found: ID does not exist" containerID="e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395" Jun 11 00:06:30.586267 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.586223 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395"} err="failed to get container status \"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395\": rpc error: code = NotFound desc = could not find container \"e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395\": container with ID starting with e5c30288c702adc7f870abf2cd73ae35155280973d1594f4e4d2e6c5088fc395 not found: ID does not exist" Jun 11 00:06:30.597782 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.597759 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:06:30.601629 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:30.601609 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f69cd8d55-w7hzk"] Jun 11 00:06:31.423544 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:31.423510 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" path="/var/lib/kubelet/pods/02cece17-e013-4690-8e6e-1db8c2d14d82/volumes" Jun 11 00:06:43.560874 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.560838 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2"] Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561157 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerName="console" Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561172 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerName="console" Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561222 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561228 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561296 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="02cece17-e013-4690-8e6e-1db8c2d14d82" containerName="console" Jun 11 00:06:43.561367 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.561309 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4b6a0be-b2e7-40b8-9329-956060bee941" containerName="console" Jun 11 00:06:43.564280 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.564263 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.566733 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.566708 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 11 00:06:43.566868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.566774 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 11 00:06:43.567144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.567111 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 11 00:06:43.567144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.567137 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 11 00:06:43.567407 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.567294 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 11 00:06:43.567407 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.567370 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-l6fjz\"" Jun 11 00:06:43.571975 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.571951 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 11 00:06:43.575640 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.575615 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2"] Jun 11 00:06:43.654518 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654483 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654518 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654524 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl5cm\" (UniqueName: \"kubernetes.io/projected/072e0065-992b-4244-81c6-74e9009b7c8c-kube-api-access-nl5cm\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-federate-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654625 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-metrics-client-ca\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654654 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-serving-certs-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654674 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.654786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.654743 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.755961 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.755926 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756133 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.755975 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756133 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756091 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nl5cm\" (UniqueName: \"kubernetes.io/projected/072e0065-992b-4244-81c6-74e9009b7c8c-kube-api-access-nl5cm\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756211 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756141 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-federate-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756211 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756197 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-metrics-client-ca\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756283 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756224 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-serving-certs-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756392 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756366 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.756500 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756458 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.757003 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.756977 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-serving-certs-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.757114 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.757042 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-metrics-client-ca\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.757348 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.757326 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.758549 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.758521 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-telemeter-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.758807 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.758787 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.759017 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.758998 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-federate-client-tls\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.759053 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.759004 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/072e0065-992b-4244-81c6-74e9009b7c8c-secret-telemeter-client\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.764323 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.764301 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl5cm\" (UniqueName: \"kubernetes.io/projected/072e0065-992b-4244-81c6-74e9009b7c8c-kube-api-access-nl5cm\") pod \"telemeter-client-7c9cd7cb78-nqzm2\" (UID: \"072e0065-992b-4244-81c6-74e9009b7c8c\") " pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:43.874258 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:43.874171 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" Jun 11 00:06:44.007508 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:44.007481 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2"] Jun 11 00:06:44.009373 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:06:44.009347 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod072e0065_992b_4244_81c6_74e9009b7c8c.slice/crio-3f31f02a974a1d5377e698d6ed8b2f297171eff86e1a7caacd7c47be52778ba5 WatchSource:0}: Error finding container 3f31f02a974a1d5377e698d6ed8b2f297171eff86e1a7caacd7c47be52778ba5: Status 404 returned error can't find the container with id 3f31f02a974a1d5377e698d6ed8b2f297171eff86e1a7caacd7c47be52778ba5 Jun 11 00:06:44.011360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:44.011344 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 00:06:44.630716 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:44.630683 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" event={"ID":"072e0065-992b-4244-81c6-74e9009b7c8c","Type":"ContainerStarted","Data":"3f31f02a974a1d5377e698d6ed8b2f297171eff86e1a7caacd7c47be52778ba5"} Jun 11 00:06:46.641117 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:46.641069 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" event={"ID":"072e0065-992b-4244-81c6-74e9009b7c8c","Type":"ContainerStarted","Data":"da049ea5cb1e248ffb9373610dcfa7eb140ccd3001edabb8754ac9a1e0fd1d01"} Jun 11 00:06:46.641545 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:46.641143 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" event={"ID":"072e0065-992b-4244-81c6-74e9009b7c8c","Type":"ContainerStarted","Data":"27e50b555adfffd0a5ff7254e51f56be038462cb05c308b141d22c21fc03f3e8"} Jun 11 00:06:46.641545 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:46.641170 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" event={"ID":"072e0065-992b-4244-81c6-74e9009b7c8c","Type":"ContainerStarted","Data":"f643729244fe1eefe8b0287587edef2485b2b0b1541327cd769886c47afd713e"} Jun 11 00:06:46.662724 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:46.662672 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7c9cd7cb78-nqzm2" podStartSLOduration=1.484775567 podStartE2EDuration="3.662654309s" totalImagesPullingTime="2.177878742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:06:46.660011077 +0000 UTC m=+337.694387630" watchObservedRunningTime="2026-06-11 00:06:46.662654309 +0000 UTC m=+337.697030864" Jun 11 00:06:47.456128 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.456099 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:06:47.458390 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.458374 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.460685 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.460655 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 00:06:47.460801 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.460779 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 00:06:47.461820 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.461800 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 00:06:47.461921 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.461851 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 00:06:47.462081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.462069 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 00:06:47.462154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.462085 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-hxwwt\"" Jun 11 00:06:47.465994 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.465975 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 00:06:47.469176 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.469157 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:06:47.485252 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485230 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485369 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485287 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485369 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485306 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485515 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485485 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485515 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485510 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctvjs\" (UniqueName: \"kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485535 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.485619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.485549 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586752 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586717 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586752 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586754 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctvjs\" (UniqueName: \"kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586779 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586801 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586863 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586900 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.586962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.586925 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.587590 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.587561 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.587590 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.587575 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.587786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.587656 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.587947 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.587922 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.589237 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.589209 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.589448 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.589433 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.593757 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.593738 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctvjs\" (UniqueName: \"kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs\") pod \"console-5d8ff85df5-b624p\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.767619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.767588 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:47.926720 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:47.926681 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:06:47.929565 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:06:47.929536 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f23a096_0a2e_4cdf_8ea5_f771d71c39a0.slice/crio-ebfcd620c0435bb0f4891bec53e31cbb2c1d515460b39cc75d9c91f7cd7413fe WatchSource:0}: Error finding container ebfcd620c0435bb0f4891bec53e31cbb2c1d515460b39cc75d9c91f7cd7413fe: Status 404 returned error can't find the container with id ebfcd620c0435bb0f4891bec53e31cbb2c1d515460b39cc75d9c91f7cd7413fe Jun 11 00:06:48.650103 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:48.650068 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ff85df5-b624p" event={"ID":"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0","Type":"ContainerStarted","Data":"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e"} Jun 11 00:06:48.650276 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:48.650122 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ff85df5-b624p" event={"ID":"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0","Type":"ContainerStarted","Data":"ebfcd620c0435bb0f4891bec53e31cbb2c1d515460b39cc75d9c91f7cd7413fe"} Jun 11 00:06:48.666868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:48.666826 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d8ff85df5-b624p" podStartSLOduration=1.666811008 podStartE2EDuration="1.666811008s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:06:48.665635136 +0000 UTC m=+339.700011691" watchObservedRunningTime="2026-06-11 00:06:48.666811008 +0000 UTC m=+339.701187561" Jun 11 00:06:57.767914 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:57.767836 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:57.767914 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:57.767901 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:57.772466 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:57.772444 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:58.693158 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.693130 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:06:58.841092 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.841060 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:06:58.843437 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.843400 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.855215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.855189 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:06:58.977684 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977585 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977684 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977631 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srd85\" (UniqueName: \"kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977709 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977740 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977786 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977842 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:58.977868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:58.977864 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078414 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078377 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078414 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078416 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srd85\" (UniqueName: \"kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078463 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078477 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078509 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078551 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.078617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.078576 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.079635 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.079602 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.079778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.079755 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.079875 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.079849 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.081770 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.081746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.084546 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.082058 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.085984 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.085962 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.086443 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.086408 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srd85\" (UniqueName: \"kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85\") pod \"console-86f8db9565-84k8n\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.153459 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.153405 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:06:59.282108 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.282064 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:06:59.284467 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:06:59.284440 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d5cf7e8_7211_47b9_9824_313f79d25f47.slice/crio-ec06ffe598895c8c3b11325767649341b735d8114d97efd946baabed816ecdd3 WatchSource:0}: Error finding container ec06ffe598895c8c3b11325767649341b735d8114d97efd946baabed816ecdd3: Status 404 returned error can't find the container with id ec06ffe598895c8c3b11325767649341b735d8114d97efd946baabed816ecdd3 Jun 11 00:06:59.694492 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.694450 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8db9565-84k8n" event={"ID":"2d5cf7e8-7211-47b9-9824-313f79d25f47","Type":"ContainerStarted","Data":"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c"} Jun 11 00:06:59.694699 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.694504 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8db9565-84k8n" event={"ID":"2d5cf7e8-7211-47b9-9824-313f79d25f47","Type":"ContainerStarted","Data":"ec06ffe598895c8c3b11325767649341b735d8114d97efd946baabed816ecdd3"} Jun 11 00:06:59.711697 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:06:59.711645 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86f8db9565-84k8n" podStartSLOduration=1.711629844 podStartE2EDuration="1.711629844s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:06:59.71024209 +0000 UTC m=+350.744618635" watchObservedRunningTime="2026-06-11 00:06:59.711629844 +0000 UTC m=+350.746006398" Jun 11 00:07:09.153799 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:09.153747 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:07:09.154325 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:09.153838 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:07:09.158374 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:09.158349 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:07:09.737233 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:09.737202 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:07:09.780455 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:09.780409 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:07:34.807953 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:34.807892 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d8ff85df5-b624p" podUID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" containerName="console" containerID="cri-o://0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e" gracePeriod=15 Jun 11 00:07:35.056897 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.056872 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:07:35.085682 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085593 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctvjs\" (UniqueName: \"kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085682 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085631 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085682 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085652 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085693 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085730 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085749 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.085965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.085801 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config\") pod \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\" (UID: \"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0\") " Jun 11 00:07:35.086235 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.086103 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca" (OuterVolumeSpecName: "service-ca") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:07:35.086235 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.086167 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:07:35.086466 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.086390 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config" (OuterVolumeSpecName: "console-config") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:07:35.086608 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.086582 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:07:35.087942 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.087912 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs" (OuterVolumeSpecName: "kube-api-access-ctvjs") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "kube-api-access-ctvjs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:07:35.088056 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.087962 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:07:35.088056 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.087987 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" (UID: "3f23a096-0a2e-4cdf-8ea5-f771d71c39a0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:07:35.186709 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186679 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctvjs\" (UniqueName: \"kubernetes.io/projected/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-kube-api-access-ctvjs\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186709 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186708 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186721 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186737 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186747 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186757 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.186920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.186765 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:07:35.833195 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.833161 2558 generic.go:356] "Generic (PLEG): container finished" podID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" containerID="0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e" exitCode=0 Jun 11 00:07:35.833604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.833208 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d8ff85df5-b624p" Jun 11 00:07:35.833604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.833246 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ff85df5-b624p" event={"ID":"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0","Type":"ContainerDied","Data":"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e"} Jun 11 00:07:35.833604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.833308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d8ff85df5-b624p" event={"ID":"3f23a096-0a2e-4cdf-8ea5-f771d71c39a0","Type":"ContainerDied","Data":"ebfcd620c0435bb0f4891bec53e31cbb2c1d515460b39cc75d9c91f7cd7413fe"} Jun 11 00:07:35.833604 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.833344 2558 scope.go:117] "RemoveContainer" containerID="0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e" Jun 11 00:07:35.841381 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.841363 2558 scope.go:117] "RemoveContainer" containerID="0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e" Jun 11 00:07:35.841644 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:07:35.841623 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e\": container with ID starting with 0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e not found: ID does not exist" containerID="0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e" Jun 11 00:07:35.841725 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.841656 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e"} err="failed to get container status \"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e\": rpc error: code = NotFound desc = could not find container \"0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e\": container with ID starting with 0d1906a129edfeffa8e9546cd17964762eb46b86d4b2666f8acc0051dd00a20e not found: ID does not exist" Jun 11 00:07:35.847843 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.847823 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:07:35.849149 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:35.849131 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d8ff85df5-b624p"] Jun 11 00:07:37.424353 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:07:37.424320 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" path="/var/lib/kubelet/pods/3f23a096-0a2e-4cdf-8ea5-f771d71c39a0/volumes" Jun 11 00:08:47.001481 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.001447 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-gz89p"] Jun 11 00:08:47.001932 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.001779 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" containerName="console" Jun 11 00:08:47.001932 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.001790 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" containerName="console" Jun 11 00:08:47.001932 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.001854 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f23a096-0a2e-4cdf-8ea5-f771d71c39a0" containerName="console" Jun 11 00:08:47.004692 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.004674 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.007079 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.007057 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 00:08:47.007166 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.007057 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 00:08:47.008019 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.008005 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2hthp\"" Jun 11 00:08:47.014296 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.014277 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gz89p"] Jun 11 00:08:47.066597 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.066568 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-bound-sa-token\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.066719 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.066599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjzfv\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-kube-api-access-pjzfv\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.167555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.167517 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-bound-sa-token\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.167555 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.167555 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjzfv\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-kube-api-access-pjzfv\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.175153 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.175128 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-bound-sa-token\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.175153 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.175146 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjzfv\" (UniqueName: \"kubernetes.io/projected/2fce0786-a86e-40cc-a69e-c78b75742751-kube-api-access-pjzfv\") pod \"cert-manager-59c77684cc-gz89p\" (UID: \"2fce0786-a86e-40cc-a69e-c78b75742751\") " pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.325287 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.325190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-gz89p" Jun 11 00:08:47.457590 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:47.457561 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-gz89p"] Jun 11 00:08:47.460566 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:08:47.460529 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fce0786_a86e_40cc_a69e_c78b75742751.slice/crio-57dce7360b60afd5cad2d0874d50273ae847b98a2bd51972d9505040754080d4 WatchSource:0}: Error finding container 57dce7360b60afd5cad2d0874d50273ae847b98a2bd51972d9505040754080d4: Status 404 returned error can't find the container with id 57dce7360b60afd5cad2d0874d50273ae847b98a2bd51972d9505040754080d4 Jun 11 00:08:48.108433 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:48.108385 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gz89p" event={"ID":"2fce0786-a86e-40cc-a69e-c78b75742751","Type":"ContainerStarted","Data":"57dce7360b60afd5cad2d0874d50273ae847b98a2bd51972d9505040754080d4"} Jun 11 00:08:51.123415 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:51.123378 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-gz89p" event={"ID":"2fce0786-a86e-40cc-a69e-c78b75742751","Type":"ContainerStarted","Data":"05d8f7c2cea8e0b051d0d9784468627d63e29978c2d3b7e5e1c0ede85e1534cc"} Jun 11 00:08:51.137519 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:08:51.137472 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-gz89p" podStartSLOduration=2.11454911 podStartE2EDuration="5.137456493s" totalImagesPullingTime="3.022907383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:08:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:08:51.136799571 +0000 UTC m=+462.171176125" watchObservedRunningTime="2026-06-11 00:08:51.137456493 +0000 UTC m=+462.171833047" Jun 11 00:09:08.992561 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:08.992524 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm"] Jun 11 00:09:08.997394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:08.997370 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:08.999941 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:08.999918 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 00:09:09.000101 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.000081 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 00:09:09.000190 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.000175 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r78rc\"" Jun 11 00:09:09.000522 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.000495 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 00:09:09.000580 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.000517 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 00:09:09.011745 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.011718 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm"] Jun 11 00:09:09.050089 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.050065 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nmg9\" (UniqueName: \"kubernetes.io/projected/c5e3e1c9-9faa-4abe-b161-8478125932dd-kube-api-access-2nmg9\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.050193 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.050107 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-tmp\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.050193 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.050177 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.050283 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.050198 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.050283 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.050218 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-manifests\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.150835 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.150809 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.150961 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.150839 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.150961 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.150860 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-manifests\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.150961 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.150887 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2nmg9\" (UniqueName: \"kubernetes.io/projected/c5e3e1c9-9faa-4abe-b161-8478125932dd-kube-api-access-2nmg9\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.150961 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.150914 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-tmp\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.151284 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.151263 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-manifests\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.153145 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.153117 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c5e3e1c9-9faa-4abe-b161-8478125932dd-tmp\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.153362 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.153347 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.153442 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.153379 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c5e3e1c9-9faa-4abe-b161-8478125932dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.158994 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.158974 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nmg9\" (UniqueName: \"kubernetes.io/projected/c5e3e1c9-9faa-4abe-b161-8478125932dd-kube-api-access-2nmg9\") pod \"opendatahub-operator-controller-manager-948c7c79b-rldjm\" (UID: \"c5e3e1c9-9faa-4abe-b161-8478125932dd\") " pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.308008 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.307976 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:09.443181 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:09.443151 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm"] Jun 11 00:09:09.445725 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:09:09.445700 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e3e1c9_9faa_4abe_b161_8478125932dd.slice/crio-17b9e44b5965a57704846c3099563f83d0e9d069cf91e8ee9d44a068a958d109 WatchSource:0}: Error finding container 17b9e44b5965a57704846c3099563f83d0e9d069cf91e8ee9d44a068a958d109: Status 404 returned error can't find the container with id 17b9e44b5965a57704846c3099563f83d0e9d069cf91e8ee9d44a068a958d109 Jun 11 00:09:10.202875 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:10.202838 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" event={"ID":"c5e3e1c9-9faa-4abe-b161-8478125932dd","Type":"ContainerStarted","Data":"17b9e44b5965a57704846c3099563f83d0e9d069cf91e8ee9d44a068a958d109"} Jun 11 00:09:13.218867 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:13.218836 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" event={"ID":"c5e3e1c9-9faa-4abe-b161-8478125932dd","Type":"ContainerStarted","Data":"1a55050df6940691b8ce5905ec5c69053844d98b0132094f4c5df80355d197b0"} Jun 11 00:09:14.229909 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:14.229873 2558 generic.go:356] "Generic (PLEG): container finished" podID="c5e3e1c9-9faa-4abe-b161-8478125932dd" containerID="1a55050df6940691b8ce5905ec5c69053844d98b0132094f4c5df80355d197b0" exitCode=0 Jun 11 00:09:14.230278 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:14.229959 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" event={"ID":"c5e3e1c9-9faa-4abe-b161-8478125932dd","Type":"ContainerDied","Data":"1a55050df6940691b8ce5905ec5c69053844d98b0132094f4c5df80355d197b0"} Jun 11 00:09:15.236174 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:15.236139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" event={"ID":"c5e3e1c9-9faa-4abe-b161-8478125932dd","Type":"ContainerStarted","Data":"306b57270e50b7802f75f54512d3062a67f032e7073a0f7611e40b945290b16b"} Jun 11 00:09:15.236567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:15.236235 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:15.256259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:15.256189 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" podStartSLOduration=2.856075236 podStartE2EDuration="7.256176995s" totalImagesPullingTime="3.326507445s" totalInitContainerRuntime="1.073594314s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:09:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:09:15.255707739 +0000 UTC m=+486.290084293" watchObservedRunningTime="2026-06-11 00:09:15.256176995 +0000 UTC m=+486.290553549" Jun 11 00:09:26.243211 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:26.243183 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-948c7c79b-rldjm" Jun 11 00:09:28.416707 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.416675 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr"] Jun 11 00:09:28.419871 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.419849 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.422298 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.422275 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 00:09:28.422455 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.422275 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 00:09:28.435277 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.435253 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr"] Jun 11 00:09:28.521267 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.521241 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tmp\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.521459 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.521294 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72gb7\" (UniqueName: \"kubernetes.io/projected/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-kube-api-access-72gb7\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.521459 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.521345 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.622566 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.622534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72gb7\" (UniqueName: \"kubernetes.io/projected/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-kube-api-access-72gb7\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.622717 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.622578 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.622717 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.622621 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tmp\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.622801 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:09:28.622713 2558 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 11 00:09:28.622801 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:09:28.622786 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs podName:c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa nodeName:}" failed. No retries permitted until 2026-06-11 00:09:29.12276923 +0000 UTC m=+500.157145761 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs") pod "kube-auth-proxy-db9bd6bdc-nbdnr" (UID: "c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa") : secret "kube-auth-proxy-tls" not found Jun 11 00:09:28.624754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.624730 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tmp\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:28.633365 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:28.633341 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-72gb7\" (UniqueName: \"kubernetes.io/projected/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-kube-api-access-72gb7\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:29.117985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.117957 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h4s6t"] Jun 11 00:09:29.121582 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.121563 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.123884 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.123856 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 00:09:29.128273 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.128250 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:29.129793 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.129770 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h4s6t"] Jun 11 00:09:29.131174 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.131149 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa-tls-certs\") pod \"kube-auth-proxy-db9bd6bdc-nbdnr\" (UID: \"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa\") " pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:29.229479 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.229454 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttntv\" (UniqueName: \"kubernetes.io/projected/9f1c6f9f-985c-417d-b555-ad3545933c0d-kube-api-access-ttntv\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.229625 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.229503 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.329654 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.329623 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" Jun 11 00:09:29.329900 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.329879 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttntv\" (UniqueName: \"kubernetes.io/projected/9f1c6f9f-985c-417d-b555-ad3545933c0d-kube-api-access-ttntv\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.329978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.329943 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.330082 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:09:29.330067 2558 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 00:09:29.330149 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:09:29.330142 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs podName:9f1c6f9f-985c-417d-b555-ad3545933c0d nodeName:}" failed. No retries permitted until 2026-06-11 00:09:29.830121958 +0000 UTC m=+500.864498507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs") pod "model-serving-api-5dd488fc48-h4s6t" (UID: "9f1c6f9f-985c-417d-b555-ad3545933c0d") : secret "model-serving-api-tls" not found Jun 11 00:09:29.338347 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.338325 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttntv\" (UniqueName: \"kubernetes.io/projected/9f1c6f9f-985c-417d-b555-ad3545933c0d-kube-api-access-ttntv\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.455364 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.455342 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr"] Jun 11 00:09:29.457098 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:09:29.457067 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e1f6b2_9103_4431_ada7_0c88d3a8b1fa.slice/crio-3075e7c11806cd98837273f9a2481915f3145201bc6e0db25261df48811aa6b3 WatchSource:0}: Error finding container 3075e7c11806cd98837273f9a2481915f3145201bc6e0db25261df48811aa6b3: Status 404 returned error can't find the container with id 3075e7c11806cd98837273f9a2481915f3145201bc6e0db25261df48811aa6b3 Jun 11 00:09:29.833632 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.833597 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:29.835943 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:29.835920 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9f1c6f9f-985c-417d-b555-ad3545933c0d-tls-certs\") pod \"model-serving-api-5dd488fc48-h4s6t\" (UID: \"9f1c6f9f-985c-417d-b555-ad3545933c0d\") " pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:30.032912 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:30.032883 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:30.302400 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:30.302364 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" event={"ID":"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa","Type":"ContainerStarted","Data":"3075e7c11806cd98837273f9a2481915f3145201bc6e0db25261df48811aa6b3"} Jun 11 00:09:30.371594 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:30.371547 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-h4s6t"] Jun 11 00:09:30.374062 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:09:30.373999 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f1c6f9f_985c_417d_b555_ad3545933c0d.slice/crio-a99bca991c907f1ec3123b3a0ffc6c26de54e7bce4db357a42f4f8ce7652cb0f WatchSource:0}: Error finding container a99bca991c907f1ec3123b3a0ffc6c26de54e7bce4db357a42f4f8ce7652cb0f: Status 404 returned error can't find the container with id a99bca991c907f1ec3123b3a0ffc6c26de54e7bce4db357a42f4f8ce7652cb0f Jun 11 00:09:31.310339 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:31.310302 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" event={"ID":"9f1c6f9f-985c-417d-b555-ad3545933c0d","Type":"ContainerStarted","Data":"a99bca991c907f1ec3123b3a0ffc6c26de54e7bce4db357a42f4f8ce7652cb0f"} Jun 11 00:09:33.323479 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:33.323438 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" event={"ID":"9f1c6f9f-985c-417d-b555-ad3545933c0d","Type":"ContainerStarted","Data":"45197f70680dcdb462cacc989d514bbd27cd121eb623c7e1b21ab77f3cad752f"} Jun 11 00:09:33.324026 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:33.323789 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:33.325271 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:33.325249 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" event={"ID":"c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa","Type":"ContainerStarted","Data":"8054c37ad20ee6e6685166a672f4428427b53a9e013ff0ffcd9e13e9da560456"} Jun 11 00:09:33.340488 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:33.340443 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" podStartSLOduration=1.494684855 podStartE2EDuration="4.340415181s" totalImagesPullingTime="2.845730326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:09:33.33892573 +0000 UTC m=+504.373302284" watchObservedRunningTime="2026-06-11 00:09:33.340415181 +0000 UTC m=+504.374791735" Jun 11 00:09:33.353547 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:33.353503 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-db9bd6bdc-nbdnr" podStartSLOduration=1.583447052 podStartE2EDuration="5.353492685s" totalImagesPullingTime="3.770045633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:09:33.351813105 +0000 UTC m=+504.386189719" watchObservedRunningTime="2026-06-11 00:09:33.353492685 +0000 UTC m=+504.387869239" Jun 11 00:09:37.407170 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.407133 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h"] Jun 11 00:09:37.410639 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.410617 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.413650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.413624 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 00:09:37.413773 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.413660 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8cgb5\"" Jun 11 00:09:37.438237 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.438206 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h"] Jun 11 00:09:37.504171 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.504139 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.504337 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.504195 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rlf5c\" (UniqueName: \"kubernetes.io/projected/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-kube-api-access-rlf5c\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.605596 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.605558 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.605772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.605647 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rlf5c\" (UniqueName: \"kubernetes.io/projected/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-kube-api-access-rlf5c\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.608015 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.607984 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.618442 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.618396 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rlf5c\" (UniqueName: \"kubernetes.io/projected/d8530f70-8bec-4637-ad40-2b86dbf7eaeb-kube-api-access-rlf5c\") pod \"llmisvc-controller-manager-864bfd7bc9-rqz4h\" (UID: \"d8530f70-8bec-4637-ad40-2b86dbf7eaeb\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.721851 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.721766 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:37.769870 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.769840 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd"] Jun 11 00:09:37.774005 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.773978 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:37.776751 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.776724 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 00:09:37.777704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.777148 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 00:09:37.777704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.777206 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fxgnd\"" Jun 11 00:09:37.777704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.777384 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 00:09:37.777704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.777498 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 00:09:37.777704 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.777591 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 00:09:37.781768 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.781748 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd"] Jun 11 00:09:37.864995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.864973 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h"] Jun 11 00:09:37.867065 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:09:37.867040 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd8530f70_8bec_4637_ad40_2b86dbf7eaeb.slice/crio-1f44e87346465eb52f8576563b0a21c287ff7fa8d157b5bdddfad4875d73000a WatchSource:0}: Error finding container 1f44e87346465eb52f8576563b0a21c287ff7fa8d157b5bdddfad4875d73000a: Status 404 returned error can't find the container with id 1f44e87346465eb52f8576563b0a21c287ff7fa8d157b5bdddfad4875d73000a Jun 11 00:09:37.908215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.908178 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-metrics-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:37.908336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.908224 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cl74w\" (UniqueName: \"kubernetes.io/projected/c438a717-8e9e-41ad-bbf2-eadab14b607b-kube-api-access-cl74w\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:37.908336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.908277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:37.908413 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:37.908367 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c438a717-8e9e-41ad-bbf2-eadab14b607b-manager-config\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.009570 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.009534 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cl74w\" (UniqueName: \"kubernetes.io/projected/c438a717-8e9e-41ad-bbf2-eadab14b607b-kube-api-access-cl74w\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.009734 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.009594 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.009734 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.009673 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c438a717-8e9e-41ad-bbf2-eadab14b607b-manager-config\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.009734 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.009721 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-metrics-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.010286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.010265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c438a717-8e9e-41ad-bbf2-eadab14b607b-manager-config\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.011970 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.011948 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.012039 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.011985 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c438a717-8e9e-41ad-bbf2-eadab14b607b-metrics-cert\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.018209 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.018192 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cl74w\" (UniqueName: \"kubernetes.io/projected/c438a717-8e9e-41ad-bbf2-eadab14b607b-kube-api-access-cl74w\") pod \"lws-controller-manager-5f9dd6846b-28qmd\" (UID: \"c438a717-8e9e-41ad-bbf2-eadab14b607b\") " pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.089206 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.089182 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:38.222504 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.222480 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd"] Jun 11 00:09:38.224273 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:09:38.224250 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc438a717_8e9e_41ad_bbf2_eadab14b607b.slice/crio-c572173ad0feb60bd15b77e33bb8b15da9fb78e28c21a2d2a60f5097df3c1b22 WatchSource:0}: Error finding container c572173ad0feb60bd15b77e33bb8b15da9fb78e28c21a2d2a60f5097df3c1b22: Status 404 returned error can't find the container with id c572173ad0feb60bd15b77e33bb8b15da9fb78e28c21a2d2a60f5097df3c1b22 Jun 11 00:09:38.349399 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.349308 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" event={"ID":"c438a717-8e9e-41ad-bbf2-eadab14b607b","Type":"ContainerStarted","Data":"c572173ad0feb60bd15b77e33bb8b15da9fb78e28c21a2d2a60f5097df3c1b22"} Jun 11 00:09:38.350525 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:38.350489 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" event={"ID":"d8530f70-8bec-4637-ad40-2b86dbf7eaeb","Type":"ContainerStarted","Data":"1f44e87346465eb52f8576563b0a21c287ff7fa8d157b5bdddfad4875d73000a"} Jun 11 00:09:42.378164 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.378124 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" event={"ID":"d8530f70-8bec-4637-ad40-2b86dbf7eaeb","Type":"ContainerStarted","Data":"90a51a39192ce62d2f0f4df64b25cbbf954bbffd6cba997e56c4bc0a0632366a"} Jun 11 00:09:42.378643 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.378265 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:09:42.379679 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.379657 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" event={"ID":"c438a717-8e9e-41ad-bbf2-eadab14b607b","Type":"ContainerStarted","Data":"73c0646a4ae4cb32d09cc87fc7a60006f0bbb57dad1bb1eb3c8076bcc22a5a62"} Jun 11 00:09:42.379773 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.379710 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:09:42.394007 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.393964 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" podStartSLOduration=1.679881092 podStartE2EDuration="5.393952168s" totalImagesPullingTime="3.714071076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:09:42.392166575 +0000 UTC m=+513.426543132" watchObservedRunningTime="2026-06-11 00:09:42.393952168 +0000 UTC m=+513.428328721" Jun 11 00:09:42.406563 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:42.406521 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" podStartSLOduration=2.05108136 podStartE2EDuration="5.406507735s" totalImagesPullingTime="3.355426375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:09:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:09:42.405490006 +0000 UTC m=+513.439866562" watchObservedRunningTime="2026-06-11 00:09:42.406507735 +0000 UTC m=+513.440884289" Jun 11 00:09:44.335305 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:44.335273 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-h4s6t" Jun 11 00:09:53.387324 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:09:53.387290 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f9dd6846b-28qmd" Jun 11 00:10:13.387601 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:10:13.387521 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-rqz4h" Jun 11 00:11:09.401215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:11:09.401188 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:11:09.402962 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:11:09.402944 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:12:13.233006 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:13.232964 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:12:15.324686 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.324650 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:15.327151 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.327133 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:15.330054 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.329973 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-cq9vj\"" Jun 11 00:12:15.330355 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.330334 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 00:12:15.331215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.331185 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 00:12:15.332010 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.331990 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:15.424082 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.424054 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:12:15.425620 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.425599 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65xkw\" (UniqueName: \"kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw\") pod \"authorino-58cd955675-6ng4j\" (UID: \"0d3df8a3-fdf5-43f3-933e-7b25d0e48788\") " pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:15.426661 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.426639 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:12:15.428376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.428353 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:12:15.526118 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.526089 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkzmr\" (UniqueName: \"kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr\") pod \"authorino-75d556bd77-bzrsj\" (UID: \"de633afb-52b5-412f-984f-bc88ff23083a\") " pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:12:15.526268 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.526230 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65xkw\" (UniqueName: \"kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw\") pod \"authorino-58cd955675-6ng4j\" (UID: \"0d3df8a3-fdf5-43f3-933e-7b25d0e48788\") " pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:15.533774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.533746 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65xkw\" (UniqueName: \"kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw\") pod \"authorino-58cd955675-6ng4j\" (UID: \"0d3df8a3-fdf5-43f3-933e-7b25d0e48788\") " pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:15.627023 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.626938 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkzmr\" (UniqueName: \"kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr\") pod \"authorino-75d556bd77-bzrsj\" (UID: \"de633afb-52b5-412f-984f-bc88ff23083a\") " pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:12:15.635331 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.635305 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkzmr\" (UniqueName: \"kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr\") pod \"authorino-75d556bd77-bzrsj\" (UID: \"de633afb-52b5-412f-984f-bc88ff23083a\") " pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:12:15.637920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.637895 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:15.735852 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.735823 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:12:15.769906 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.769885 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:15.774165 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:12:15.774126 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d3df8a3_fdf5_43f3_933e_7b25d0e48788.slice/crio-af29fa000d24eeea3c556e6b1efb6b067c18df9948d9e80a3c866f0ed571a25e WatchSource:0}: Error finding container af29fa000d24eeea3c556e6b1efb6b067c18df9948d9e80a3c866f0ed571a25e: Status 404 returned error can't find the container with id af29fa000d24eeea3c556e6b1efb6b067c18df9948d9e80a3c866f0ed571a25e Jun 11 00:12:15.775754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.775735 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 00:12:15.869101 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:15.869068 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:12:15.871096 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:12:15.871067 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde633afb_52b5_412f_984f_bc88ff23083a.slice/crio-5cca75c63c996979abbce6de2eed512deb0128a69f56c84ac7e14fc6ef3ffdec WatchSource:0}: Error finding container 5cca75c63c996979abbce6de2eed512deb0128a69f56c84ac7e14fc6ef3ffdec: Status 404 returned error can't find the container with id 5cca75c63c996979abbce6de2eed512deb0128a69f56c84ac7e14fc6ef3ffdec Jun 11 00:12:16.060374 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:16.060340 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bzrsj" event={"ID":"de633afb-52b5-412f-984f-bc88ff23083a","Type":"ContainerStarted","Data":"5cca75c63c996979abbce6de2eed512deb0128a69f56c84ac7e14fc6ef3ffdec"} Jun 11 00:12:16.061438 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:16.061397 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ng4j" event={"ID":"0d3df8a3-fdf5-43f3-933e-7b25d0e48788","Type":"ContainerStarted","Data":"af29fa000d24eeea3c556e6b1efb6b067c18df9948d9e80a3c866f0ed571a25e"} Jun 11 00:12:20.086833 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:20.086795 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bzrsj" event={"ID":"de633afb-52b5-412f-984f-bc88ff23083a","Type":"ContainerStarted","Data":"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1"} Jun 11 00:12:20.088307 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:20.088271 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ng4j" event={"ID":"0d3df8a3-fdf5-43f3-933e-7b25d0e48788","Type":"ContainerStarted","Data":"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad"} Jun 11 00:12:20.102212 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:20.102167 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-bzrsj" podStartSLOduration=1.47155544 podStartE2EDuration="5.102152621s" totalImagesPullingTime="3.630597181s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:12:20.100051006 +0000 UTC m=+671.134427560" watchObservedRunningTime="2026-06-11 00:12:20.102152621 +0000 UTC m=+671.136529152" Jun 11 00:12:20.113008 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:20.112957 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6ng4j" podStartSLOduration=1.376020957 podStartE2EDuration="5.112940057s" totalImagesPullingTime="3.7369191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:12:20.112814789 +0000 UTC m=+671.147191351" watchObservedRunningTime="2026-06-11 00:12:20.112940057 +0000 UTC m=+671.147316614" Jun 11 00:12:20.129404 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:20.129379 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:22.096847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:22.096811 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6ng4j" podUID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" containerName="authorino" containerID="cri-o://814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad" gracePeriod=30 Jun 11 00:12:22.346351 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:22.346321 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:22.494864 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:22.494794 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65xkw\" (UniqueName: \"kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw\") pod \"0d3df8a3-fdf5-43f3-933e-7b25d0e48788\" (UID: \"0d3df8a3-fdf5-43f3-933e-7b25d0e48788\") " Jun 11 00:12:22.496898 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:22.496871 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw" (OuterVolumeSpecName: "kube-api-access-65xkw") pod "0d3df8a3-fdf5-43f3-933e-7b25d0e48788" (UID: "0d3df8a3-fdf5-43f3-933e-7b25d0e48788"). InnerVolumeSpecName "kube-api-access-65xkw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:12:22.596373 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:22.596335 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65xkw\" (UniqueName: \"kubernetes.io/projected/0d3df8a3-fdf5-43f3-933e-7b25d0e48788-kube-api-access-65xkw\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:23.101926 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.101894 2558 generic.go:356] "Generic (PLEG): container finished" podID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" containerID="814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad" exitCode=0 Jun 11 00:12:23.102345 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.101936 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6ng4j" Jun 11 00:12:23.102345 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.101942 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ng4j" event={"ID":"0d3df8a3-fdf5-43f3-933e-7b25d0e48788","Type":"ContainerDied","Data":"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad"} Jun 11 00:12:23.102345 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.101974 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6ng4j" event={"ID":"0d3df8a3-fdf5-43f3-933e-7b25d0e48788","Type":"ContainerDied","Data":"af29fa000d24eeea3c556e6b1efb6b067c18df9948d9e80a3c866f0ed571a25e"} Jun 11 00:12:23.102345 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.101991 2558 scope.go:117] "RemoveContainer" containerID="814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad" Jun 11 00:12:23.110578 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.110563 2558 scope.go:117] "RemoveContainer" containerID="814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad" Jun 11 00:12:23.110815 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:12:23.110799 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad\": container with ID starting with 814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad not found: ID does not exist" containerID="814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad" Jun 11 00:12:23.110862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.110822 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad"} err="failed to get container status \"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad\": rpc error: code = NotFound desc = could not find container \"814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad\": container with ID starting with 814e97fafc336ae8dd85eea8b0a08cc6c1033da51b9487446d6ffd742c8560ad not found: ID does not exist" Jun 11 00:12:23.121132 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.121112 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:23.124356 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.124336 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6ng4j"] Jun 11 00:12:23.424285 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:23.424210 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" path="/var/lib/kubelet/pods/0d3df8a3-fdf5-43f3-933e-7b25d0e48788/volumes" Jun 11 00:12:38.255000 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.254946 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86f8db9565-84k8n" podUID="2d5cf7e8-7211-47b9-9824-313f79d25f47" containerName="console" containerID="cri-o://0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c" gracePeriod=15 Jun 11 00:12:38.494777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.494755 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:12:38.526860 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.526804 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.526860 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.526845 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527043 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.526873 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srd85\" (UniqueName: \"kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527043 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.526892 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527153 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527067 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527153 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527114 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527256 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527168 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config\") pod \"2d5cf7e8-7211-47b9-9824-313f79d25f47\" (UID: \"2d5cf7e8-7211-47b9-9824-313f79d25f47\") " Jun 11 00:12:38.527256 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527222 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca" (OuterVolumeSpecName: "service-ca") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:12:38.527256 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527243 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:12:38.527532 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527506 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config" (OuterVolumeSpecName: "console-config") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:12:38.527611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527542 2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-service-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.527611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527560 2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-oauth-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.527611 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.527565 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:12:38.528995 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.528964 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85" (OuterVolumeSpecName: "kube-api-access-srd85") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "kube-api-access-srd85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:12:38.529097 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.529072 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:12:38.529188 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.529165 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2d5cf7e8-7211-47b9-9824-313f79d25f47" (UID: "2d5cf7e8-7211-47b9-9824-313f79d25f47"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:12:38.628390 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.628358 2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-oauth-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.628390 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.628384 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srd85\" (UniqueName: \"kubernetes.io/projected/2d5cf7e8-7211-47b9-9824-313f79d25f47-kube-api-access-srd85\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.628390 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.628394 2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-trusted-ca-bundle\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.628619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.628403 2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-serving-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:38.628619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:38.628412 2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2d5cf7e8-7211-47b9-9824-313f79d25f47-console-config\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:12:39.179977 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.179942 2558 generic.go:356] "Generic (PLEG): container finished" podID="2d5cf7e8-7211-47b9-9824-313f79d25f47" containerID="0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c" exitCode=0 Jun 11 00:12:39.180167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.179992 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86f8db9565-84k8n" Jun 11 00:12:39.180167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.180026 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8db9565-84k8n" event={"ID":"2d5cf7e8-7211-47b9-9824-313f79d25f47","Type":"ContainerDied","Data":"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c"} Jun 11 00:12:39.180167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.180074 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86f8db9565-84k8n" event={"ID":"2d5cf7e8-7211-47b9-9824-313f79d25f47","Type":"ContainerDied","Data":"ec06ffe598895c8c3b11325767649341b735d8114d97efd946baabed816ecdd3"} Jun 11 00:12:39.180167 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.180094 2558 scope.go:117] "RemoveContainer" containerID="0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c" Jun 11 00:12:39.189202 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.189188 2558 scope.go:117] "RemoveContainer" containerID="0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c" Jun 11 00:12:39.189471 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:12:39.189452 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c\": container with ID starting with 0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c not found: ID does not exist" containerID="0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c" Jun 11 00:12:39.189540 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.189480 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c"} err="failed to get container status \"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c\": rpc error: code = NotFound desc = could not find container \"0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c\": container with ID starting with 0b8509b43e65fbd827d8e2f003a1a1dd724d1b468219e8642618e1fee5c74f3c not found: ID does not exist" Jun 11 00:12:39.203612 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.203589 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:12:39.207243 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.207221 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86f8db9565-84k8n"] Jun 11 00:12:39.425691 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:12:39.425657 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d5cf7e8-7211-47b9-9824-313f79d25f47" path="/var/lib/kubelet/pods/2d5cf7e8-7211-47b9-9824-313f79d25f47/volumes" Jun 11 00:13:09.783092 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783055 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783381 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d5cf7e8-7211-47b9-9824-313f79d25f47" containerName="console" Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783392 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d5cf7e8-7211-47b9-9824-313f79d25f47" containerName="console" Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783402 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" containerName="authorino" Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783408 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" containerName="authorino" Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783480 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d5cf7e8-7211-47b9-9824-313f79d25f47" containerName="console" Jun 11 00:13:09.783509 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.783493 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d3df8a3-fdf5-43f3-933e-7b25d0e48788" containerName="authorino" Jun 11 00:13:09.786264 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.786249 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:09.788774 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.788749 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 00:13:09.788894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.788753 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 00:13:09.789779 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.789761 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 00:13:09.789833 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.789766 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k6vv2\"" Jun 11 00:13:09.793813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.793791 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:13:09.895963 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.895925 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddl5q\" (UniqueName: \"kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q\") pod \"maas-keycloak-0\" (UID: \"de9fd567-238d-4327-9842-0d8b5306b378\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:09.997254 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:09.997211 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddl5q\" (UniqueName: \"kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q\") pod \"maas-keycloak-0\" (UID: \"de9fd567-238d-4327-9842-0d8b5306b378\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:10.005556 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:10.005529 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddl5q\" (UniqueName: \"kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q\") pod \"maas-keycloak-0\" (UID: \"de9fd567-238d-4327-9842-0d8b5306b378\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:10.096060 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:10.095986 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:10.229533 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:10.229511 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:13:10.231474 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:13:10.231448 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9fd567_238d_4327_9842_0d8b5306b378.slice/crio-34f8407544b78f37c8bfe9f0e88d2a1493e77d7760f555287c5ad4b07ff4ea23 WatchSource:0}: Error finding container 34f8407544b78f37c8bfe9f0e88d2a1493e77d7760f555287c5ad4b07ff4ea23: Status 404 returned error can't find the container with id 34f8407544b78f37c8bfe9f0e88d2a1493e77d7760f555287c5ad4b07ff4ea23 Jun 11 00:13:10.324577 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:10.324536 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"de9fd567-238d-4327-9842-0d8b5306b378","Type":"ContainerStarted","Data":"34f8407544b78f37c8bfe9f0e88d2a1493e77d7760f555287c5ad4b07ff4ea23"} Jun 11 00:13:16.357957 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:16.357914 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"de9fd567-238d-4327-9842-0d8b5306b378","Type":"ContainerStarted","Data":"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0"} Jun 11 00:13:16.385490 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:16.385441 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.792552594 podStartE2EDuration="7.385402708s" totalImagesPullingTime="5.592850114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:13:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:13:16.384375395 +0000 UTC m=+727.418751950" watchObservedRunningTime="2026-06-11 00:13:16.385402708 +0000 UTC m=+727.419779286" Jun 11 00:13:17.097168 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:17.097114 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:17.099084 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:17.099044 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:18.097014 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:18.096967 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:19.097561 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:19.097508 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:20.096721 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:20.096683 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:20.097047 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:20.096999 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:21.097950 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:21.097895 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:22.096952 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:22.096886 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:23.097310 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:23.097248 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:24.096532 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:24.096484 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:25.096663 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:25.096615 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:26.096866 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:26.096817 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:27.096727 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:27.096675 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:28.096670 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:28.096627 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.33:9000/health/started\": dial tcp 10.133.0.33:9000: connect: connection refused" Jun 11 00:13:29.224485 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:29.224442 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:29.244329 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:29.244273 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:13:39.230617 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:39.230582 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 00:13:40.053442 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.053394 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76svn"] Jun 11 00:13:40.060304 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.060279 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.062765 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.062742 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76svn"] Jun 11 00:13:40.181959 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.181923 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qls8t\" (UniqueName: \"kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t\") pod \"authorino-5d4b67c446-76svn\" (UID: \"cec99b39-c488-4819-a95e-bc54d2120160\") " pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.264461 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.264434 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76svn"] Jun 11 00:13:40.264823 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:13:40.264653 2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qls8t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-76svn" podUID="cec99b39-c488-4819-a95e-bc54d2120160" Jun 11 00:13:40.283217 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.283190 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qls8t\" (UniqueName: \"kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t\") pod \"authorino-5d4b67c446-76svn\" (UID: \"cec99b39-c488-4819-a95e-bc54d2120160\") " pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.288602 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.288581 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:40.290993 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.290974 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:40.291305 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.291285 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qls8t\" (UniqueName: \"kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t\") pod \"authorino-5d4b67c446-76svn\" (UID: \"cec99b39-c488-4819-a95e-bc54d2120160\") " pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.297933 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.297912 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:40.383816 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.383774 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmpct\" (UniqueName: \"kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct\") pod \"authorino-bfc5cc757-2rkwj\" (UID: \"1d1f12f4-5b38-49ac-bd68-6f73c0110313\") " pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:40.484361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.484319 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmpct\" (UniqueName: \"kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct\") pod \"authorino-bfc5cc757-2rkwj\" (UID: \"1d1f12f4-5b38-49ac-bd68-6f73c0110313\") " pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:40.491129 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.491096 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.492388 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.492368 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmpct\" (UniqueName: \"kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct\") pod \"authorino-bfc5cc757-2rkwj\" (UID: \"1d1f12f4-5b38-49ac-bd68-6f73c0110313\") " pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:40.502899 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.502874 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:40.503274 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.503254 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:40.504440 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.504404 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:40.529074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.529047 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:13:40.531659 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.531636 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.534011 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.533990 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 00:13:40.540891 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.540869 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:13:40.585091 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.585063 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qls8t\" (UniqueName: \"kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t\") pod \"cec99b39-c488-4819-a95e-bc54d2120160\" (UID: \"cec99b39-c488-4819-a95e-bc54d2120160\") " Jun 11 00:13:40.585270 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.585253 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.585352 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.585277 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txzkf\" (UniqueName: \"kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.586978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.586953 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t" (OuterVolumeSpecName: "kube-api-access-qls8t") pod "cec99b39-c488-4819-a95e-bc54d2120160" (UID: "cec99b39-c488-4819-a95e-bc54d2120160"). InnerVolumeSpecName "kube-api-access-qls8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:13:40.635642 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.635618 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:40.638177 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:13:40.638152 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d1f12f4_5b38_49ac_bd68_6f73c0110313.slice/crio-9492ae82b89900f8758ef8ac43201c058890ce9ee341992aaa872dcf5c7b9874 WatchSource:0}: Error finding container 9492ae82b89900f8758ef8ac43201c058890ce9ee341992aaa872dcf5c7b9874: Status 404 returned error can't find the container with id 9492ae82b89900f8758ef8ac43201c058890ce9ee341992aaa872dcf5c7b9874 Jun 11 00:13:40.685724 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.685688 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.685724 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.685725 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzkf\" (UniqueName: \"kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.685935 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.685782 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qls8t\" (UniqueName: \"kubernetes.io/projected/cec99b39-c488-4819-a95e-bc54d2120160-kube-api-access-qls8t\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:13:40.688133 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.688111 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.692873 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.692854 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txzkf\" (UniqueName: \"kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf\") pod \"authorino-7774957bd9-46lgg\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.843687 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.843599 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:13:40.967382 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:40.967357 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:13:40.969390 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:13:40.969348 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfcf3228_96a1_4a00_be5d_3135689fcc20.slice/crio-299bc527cc25b9a993bd01a053dd60cf4eca414288880f5f80093dfd72ae26c5 WatchSource:0}: Error finding container 299bc527cc25b9a993bd01a053dd60cf4eca414288880f5f80093dfd72ae26c5: Status 404 returned error can't find the container with id 299bc527cc25b9a993bd01a053dd60cf4eca414288880f5f80093dfd72ae26c5 Jun 11 00:13:41.497165 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.497133 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" event={"ID":"1d1f12f4-5b38-49ac-bd68-6f73c0110313","Type":"ContainerStarted","Data":"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d"} Jun 11 00:13:41.497607 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.497175 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" event={"ID":"1d1f12f4-5b38-49ac-bd68-6f73c0110313","Type":"ContainerStarted","Data":"9492ae82b89900f8758ef8ac43201c058890ce9ee341992aaa872dcf5c7b9874"} Jun 11 00:13:41.497607 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.497170 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" podUID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" containerName="authorino" containerID="cri-o://32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d" gracePeriod=30 Jun 11 00:13:41.498965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.498942 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774957bd9-46lgg" event={"ID":"dfcf3228-96a1-4a00-be5d-3135689fcc20","Type":"ContainerStarted","Data":"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df"} Jun 11 00:13:41.499096 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.498975 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774957bd9-46lgg" event={"ID":"dfcf3228-96a1-4a00-be5d-3135689fcc20","Type":"ContainerStarted","Data":"299bc527cc25b9a993bd01a053dd60cf4eca414288880f5f80093dfd72ae26c5"} Jun 11 00:13:41.499096 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.499012 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-76svn" Jun 11 00:13:41.517525 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.517490 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" podStartSLOduration=1.105111685 podStartE2EDuration="1.517477725s" totalImagesPullingTime="412.36604ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:13:41.516527501 +0000 UTC m=+752.550904055" watchObservedRunningTime="2026-06-11 00:13:41.517477725 +0000 UTC m=+752.551854278" Jun 11 00:13:41.538073 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.538050 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76svn"] Jun 11 00:13:41.541549 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.541530 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-76svn"] Jun 11 00:13:41.555256 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.555214 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7774957bd9-46lgg" podStartSLOduration=1.265612833 podStartE2EDuration="1.555201153s" totalImagesPullingTime="289.58832ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:13:41.553303566 +0000 UTC m=+752.587680121" watchObservedRunningTime="2026-06-11 00:13:41.555201153 +0000 UTC m=+752.589577742" Jun 11 00:13:41.582291 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.582265 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:13:41.582494 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.582468 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-bzrsj" podUID="de633afb-52b5-412f-984f-bc88ff23083a" containerName="authorino" containerID="cri-o://95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1" gracePeriod=30 Jun 11 00:13:41.822603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.822579 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:41.841801 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.841778 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:13:41.896085 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.896060 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmpct\" (UniqueName: \"kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct\") pod \"1d1f12f4-5b38-49ac-bd68-6f73c0110313\" (UID: \"1d1f12f4-5b38-49ac-bd68-6f73c0110313\") " Jun 11 00:13:41.896201 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.896132 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkzmr\" (UniqueName: \"kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr\") pod \"de633afb-52b5-412f-984f-bc88ff23083a\" (UID: \"de633afb-52b5-412f-984f-bc88ff23083a\") " Jun 11 00:13:41.898031 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.897999 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct" (OuterVolumeSpecName: "kube-api-access-dmpct") pod "1d1f12f4-5b38-49ac-bd68-6f73c0110313" (UID: "1d1f12f4-5b38-49ac-bd68-6f73c0110313"). InnerVolumeSpecName "kube-api-access-dmpct". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:13:41.898138 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.898065 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr" (OuterVolumeSpecName: "kube-api-access-lkzmr") pod "de633afb-52b5-412f-984f-bc88ff23083a" (UID: "de633afb-52b5-412f-984f-bc88ff23083a"). InnerVolumeSpecName "kube-api-access-lkzmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:13:41.997648 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.997590 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmpct\" (UniqueName: \"kubernetes.io/projected/1d1f12f4-5b38-49ac-bd68-6f73c0110313-kube-api-access-dmpct\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:13:41.997648 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:41.997610 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkzmr\" (UniqueName: \"kubernetes.io/projected/de633afb-52b5-412f-984f-bc88ff23083a-kube-api-access-lkzmr\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:13:42.505209 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.505171 2558 generic.go:356] "Generic (PLEG): container finished" podID="de633afb-52b5-412f-984f-bc88ff23083a" containerID="95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1" exitCode=0 Jun 11 00:13:42.505209 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.505207 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-bzrsj" Jun 11 00:13:42.505745 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.505248 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bzrsj" event={"ID":"de633afb-52b5-412f-984f-bc88ff23083a","Type":"ContainerDied","Data":"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1"} Jun 11 00:13:42.505745 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.505288 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-bzrsj" event={"ID":"de633afb-52b5-412f-984f-bc88ff23083a","Type":"ContainerDied","Data":"5cca75c63c996979abbce6de2eed512deb0128a69f56c84ac7e14fc6ef3ffdec"} Jun 11 00:13:42.505745 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.505305 2558 scope.go:117] "RemoveContainer" containerID="95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1" Jun 11 00:13:42.506607 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.506584 2558 generic.go:356] "Generic (PLEG): container finished" podID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" containerID="32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d" exitCode=0 Jun 11 00:13:42.506732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.506624 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" Jun 11 00:13:42.506732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.506628 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" event={"ID":"1d1f12f4-5b38-49ac-bd68-6f73c0110313","Type":"ContainerDied","Data":"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d"} Jun 11 00:13:42.506732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.506660 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-bfc5cc757-2rkwj" event={"ID":"1d1f12f4-5b38-49ac-bd68-6f73c0110313","Type":"ContainerDied","Data":"9492ae82b89900f8758ef8ac43201c058890ce9ee341992aaa872dcf5c7b9874"} Jun 11 00:13:42.521614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.521598 2558 scope.go:117] "RemoveContainer" containerID="95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1" Jun 11 00:13:42.521844 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:13:42.521827 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1\": container with ID starting with 95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1 not found: ID does not exist" containerID="95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1" Jun 11 00:13:42.521888 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.521852 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1"} err="failed to get container status \"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1\": rpc error: code = NotFound desc = could not find container \"95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1\": container with ID starting with 95be86da3fb424c16f683e174c3508241a490979e5f6fa4e45c6bf6ad19afad1 not found: ID does not exist" Jun 11 00:13:42.521888 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.521869 2558 scope.go:117] "RemoveContainer" containerID="32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d" Jun 11 00:13:42.529185 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.529168 2558 scope.go:117] "RemoveContainer" containerID="32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d" Jun 11 00:13:42.529734 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:13:42.529482 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d\": container with ID starting with 32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d not found: ID does not exist" containerID="32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d" Jun 11 00:13:42.529734 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.529517 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d"} err="failed to get container status \"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d\": rpc error: code = NotFound desc = could not find container \"32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d\": container with ID starting with 32423ee0b4bd52fd7753c57eadf2410ef7e538e4239a644360ee2491be20a26d not found: ID does not exist" Jun 11 00:13:42.531369 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.531352 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:13:42.534531 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.534513 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-bzrsj"] Jun 11 00:13:42.543881 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.543863 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:42.547610 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:42.547590 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-bfc5cc757-2rkwj"] Jun 11 00:13:43.425251 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:43.425216 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" path="/var/lib/kubelet/pods/1d1f12f4-5b38-49ac-bd68-6f73c0110313/volumes" Jun 11 00:13:43.425691 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:43.425671 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cec99b39-c488-4819-a95e-bc54d2120160" path="/var/lib/kubelet/pods/cec99b39-c488-4819-a95e-bc54d2120160/volumes" Jun 11 00:13:43.425930 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:43.425913 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de633afb-52b5-412f-984f-bc88ff23083a" path="/var/lib/kubelet/pods/de633afb-52b5-412f-984f-bc88ff23083a/volumes" Jun 11 00:13:45.016801 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.016773 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:13:45.017154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017101 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" containerName="authorino" Jun 11 00:13:45.017154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017112 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" containerName="authorino" Jun 11 00:13:45.017154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017135 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de633afb-52b5-412f-984f-bc88ff23083a" containerName="authorino" Jun 11 00:13:45.017154 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017141 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de633afb-52b5-412f-984f-bc88ff23083a" containerName="authorino" Jun 11 00:13:45.017276 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017196 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1f12f4-5b38-49ac-bd68-6f73c0110313" containerName="authorino" Jun 11 00:13:45.017276 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.017207 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de633afb-52b5-412f-984f-bc88ff23083a" containerName="authorino" Jun 11 00:13:45.020492 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.020477 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.024747 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.024722 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 00:13:45.024869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.024722 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x6gg9\"" Jun 11 00:13:45.024869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.024757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 00:13:45.030408 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.030390 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:13:45.125671 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.125639 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.125817 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.125728 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szgh9\" (UniqueName: \"kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.207226 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.207180 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:13:45.210936 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.210911 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.220511 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.220480 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:13:45.226131 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.226106 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szgh9\" (UniqueName: \"kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.226211 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.226162 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.226278 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:13:45.226266 2558 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 00:13:45.226340 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:13:45.226330 2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert podName:bfe95067-605f-49a5-a37b-c5bd0d80957c nodeName:}" failed. No retries permitted until 2026-06-11 00:13:45.726299216 +0000 UTC m=+756.760675749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert") pod "maas-controller-597b95b87c-v7ws2" (UID: "bfe95067-605f-49a5-a37b-c5bd0d80957c") : secret "maas-controller-webhook-cert" not found Jun 11 00:13:45.234673 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.234648 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szgh9\" (UniqueName: \"kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.326715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.326620 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlh5k\" (UniqueName: \"kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.326715 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.326679 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.427958 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.427922 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlh5k\" (UniqueName: \"kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.427958 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.427962 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.430301 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.430273 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.435071 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.435052 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlh5k\" (UniqueName: \"kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k\") pod \"maas-controller-5b8467c765-njwqb\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.523718 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.523689 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:45.650841 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.650817 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:13:45.652181 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:13:45.652155 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97cce07b_9511_452f_b57d_66a1ef07924a.slice/crio-2b33bd0074fc86ca6d697616d112848778d7a41f32447f430c595395ea3b2da8 WatchSource:0}: Error finding container 2b33bd0074fc86ca6d697616d112848778d7a41f32447f430c595395ea3b2da8: Status 404 returned error can't find the container with id 2b33bd0074fc86ca6d697616d112848778d7a41f32447f430c595395ea3b2da8 Jun 11 00:13:45.731268 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.731236 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.733721 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.733691 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") pod \"maas-controller-597b95b87c-v7ws2\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:45.931100 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:45.931018 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:46.058582 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:46.058557 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:13:46.060758 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:13:46.060727 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfe95067_605f_49a5_a37b_c5bd0d80957c.slice/crio-3227e45bfd24b6c69061dfd996ae85f563786005aaabe1aba7f6c948eeb57c32 WatchSource:0}: Error finding container 3227e45bfd24b6c69061dfd996ae85f563786005aaabe1aba7f6c948eeb57c32: Status 404 returned error can't find the container with id 3227e45bfd24b6c69061dfd996ae85f563786005aaabe1aba7f6c948eeb57c32 Jun 11 00:13:46.530608 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:46.530568 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597b95b87c-v7ws2" event={"ID":"bfe95067-605f-49a5-a37b-c5bd0d80957c","Type":"ContainerStarted","Data":"3227e45bfd24b6c69061dfd996ae85f563786005aaabe1aba7f6c948eeb57c32"} Jun 11 00:13:46.531855 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:46.531831 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-njwqb" event={"ID":"97cce07b-9511-452f-b57d-66a1ef07924a","Type":"ContainerStarted","Data":"2b33bd0074fc86ca6d697616d112848778d7a41f32447f430c595395ea3b2da8"} Jun 11 00:13:48.548123 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.548084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597b95b87c-v7ws2" event={"ID":"bfe95067-605f-49a5-a37b-c5bd0d80957c","Type":"ContainerStarted","Data":"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2"} Jun 11 00:13:48.548631 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.548297 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:48.549627 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.549603 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-njwqb" event={"ID":"97cce07b-9511-452f-b57d-66a1ef07924a","Type":"ContainerStarted","Data":"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58"} Jun 11 00:13:48.549763 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.549735 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:48.568984 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.568937 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-597b95b87c-v7ws2" podStartSLOduration=1.429060274 podStartE2EDuration="3.568919232s" totalImagesPullingTime="2.139858958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:13:48.568442578 +0000 UTC m=+759.602819147" watchObservedRunningTime="2026-06-11 00:13:48.568919232 +0000 UTC m=+759.603295789" Jun 11 00:13:48.590230 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:48.590188 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8467c765-njwqb" podStartSLOduration=1.051584516 podStartE2EDuration="3.590175208s" totalImagesPullingTime="2.538590692s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:13:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:13:48.588756394 +0000 UTC m=+759.623132961" watchObservedRunningTime="2026-06-11 00:13:48.590175208 +0000 UTC m=+759.624551761" Jun 11 00:13:59.559406 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.559373 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:59.559826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.559551 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:13:59.615561 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.615412 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:13:59.615746 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.615661 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-597b95b87c-v7ws2" podUID="bfe95067-605f-49a5-a37b-c5bd0d80957c" containerName="manager" containerID="cri-o://28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2" gracePeriod=30 Jun 11 00:13:59.854769 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.854743 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:13:59.971945 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.971913 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") pod \"bfe95067-605f-49a5-a37b-c5bd0d80957c\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " Jun 11 00:13:59.972114 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.971968 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szgh9\" (UniqueName: \"kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9\") pod \"bfe95067-605f-49a5-a37b-c5bd0d80957c\" (UID: \"bfe95067-605f-49a5-a37b-c5bd0d80957c\") " Jun 11 00:13:59.974149 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.974119 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bfe95067-605f-49a5-a37b-c5bd0d80957c" (UID: "bfe95067-605f-49a5-a37b-c5bd0d80957c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:13:59.974246 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:13:59.974173 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9" (OuterVolumeSpecName: "kube-api-access-szgh9") pod "bfe95067-605f-49a5-a37b-c5bd0d80957c" (UID: "bfe95067-605f-49a5-a37b-c5bd0d80957c"). InnerVolumeSpecName "kube-api-access-szgh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:14:00.073411 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.073380 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szgh9\" (UniqueName: \"kubernetes.io/projected/bfe95067-605f-49a5-a37b-c5bd0d80957c-kube-api-access-szgh9\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:14:00.073411 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.073406 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bfe95067-605f-49a5-a37b-c5bd0d80957c-webhook-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:14:00.607815 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.607785 2558 generic.go:356] "Generic (PLEG): container finished" podID="bfe95067-605f-49a5-a37b-c5bd0d80957c" containerID="28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2" exitCode=0 Jun 11 00:14:00.607815 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.607819 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597b95b87c-v7ws2" event={"ID":"bfe95067-605f-49a5-a37b-c5bd0d80957c","Type":"ContainerDied","Data":"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2"} Jun 11 00:14:00.608286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.607827 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-597b95b87c-v7ws2" Jun 11 00:14:00.608286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.607859 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-597b95b87c-v7ws2" event={"ID":"bfe95067-605f-49a5-a37b-c5bd0d80957c","Type":"ContainerDied","Data":"3227e45bfd24b6c69061dfd996ae85f563786005aaabe1aba7f6c948eeb57c32"} Jun 11 00:14:00.608286 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.607881 2558 scope.go:117] "RemoveContainer" containerID="28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2" Jun 11 00:14:00.617151 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.616935 2558 scope.go:117] "RemoveContainer" containerID="28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2" Jun 11 00:14:00.617213 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:14:00.617190 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2\": container with ID starting with 28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2 not found: ID does not exist" containerID="28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2" Jun 11 00:14:00.617249 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.617217 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2"} err="failed to get container status \"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2\": rpc error: code = NotFound desc = could not find container \"28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2\": container with ID starting with 28da8e6f6a0bab477cde6594f00b954cb600dc20f46a02334857cf7e700579e2 not found: ID does not exist" Jun 11 00:14:00.628839 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.628817 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:14:00.630442 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:00.630403 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-597b95b87c-v7ws2"] Jun 11 00:14:01.424264 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:01.424232 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfe95067-605f-49a5-a37b-c5bd0d80957c" path="/var/lib/kubelet/pods/bfe95067-605f-49a5-a37b-c5bd0d80957c/volumes" Jun 11 00:14:20.002288 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.002256 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7pmsj"] Jun 11 00:14:20.002772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.002626 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfe95067-605f-49a5-a37b-c5bd0d80957c" containerName="manager" Jun 11 00:14:20.002772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.002638 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfe95067-605f-49a5-a37b-c5bd0d80957c" containerName="manager" Jun 11 00:14:20.002772 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.002698 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfe95067-605f-49a5-a37b-c5bd0d80957c" containerName="manager" Jun 11 00:14:20.005875 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.005858 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:20.008178 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.008152 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 00:14:20.008290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.008152 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-hkqlr\"" Jun 11 00:14:20.015492 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.015466 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7pmsj"] Jun 11 00:14:20.042119 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.042093 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mptnx\" (UniqueName: \"kubernetes.io/projected/2b61c15a-f271-471f-ae9b-ea0e30850103-kube-api-access-mptnx\") pod \"payload-pre-processing-579785bc64-7pmsj\" (UID: \"2b61c15a-f271-471f-ae9b-ea0e30850103\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:20.045638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.045618 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2c4ph"] Jun 11 00:14:20.047809 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.047794 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:20.058274 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.058254 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2c4ph"] Jun 11 00:14:20.143220 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.143189 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjlwb\" (UniqueName: \"kubernetes.io/projected/a00c5e59-da83-47d4-80dc-2c37e8a77788-kube-api-access-jjlwb\") pod \"payload-processing-699b6cd6c-2c4ph\" (UID: \"a00c5e59-da83-47d4-80dc-2c37e8a77788\") " pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:20.143372 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.143287 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mptnx\" (UniqueName: \"kubernetes.io/projected/2b61c15a-f271-471f-ae9b-ea0e30850103-kube-api-access-mptnx\") pod \"payload-pre-processing-579785bc64-7pmsj\" (UID: \"2b61c15a-f271-471f-ae9b-ea0e30850103\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:20.151375 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.151352 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mptnx\" (UniqueName: \"kubernetes.io/projected/2b61c15a-f271-471f-ae9b-ea0e30850103-kube-api-access-mptnx\") pod \"payload-pre-processing-579785bc64-7pmsj\" (UID: \"2b61c15a-f271-471f-ae9b-ea0e30850103\") " pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:20.244341 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.244310 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjlwb\" (UniqueName: \"kubernetes.io/projected/a00c5e59-da83-47d4-80dc-2c37e8a77788-kube-api-access-jjlwb\") pod \"payload-processing-699b6cd6c-2c4ph\" (UID: \"a00c5e59-da83-47d4-80dc-2c37e8a77788\") " pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:20.251638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.251612 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjlwb\" (UniqueName: \"kubernetes.io/projected/a00c5e59-da83-47d4-80dc-2c37e8a77788-kube-api-access-jjlwb\") pod \"payload-processing-699b6cd6c-2c4ph\" (UID: \"a00c5e59-da83-47d4-80dc-2c37e8a77788\") " pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:20.316908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.316838 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:20.357824 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.357790 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:20.463284 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.463013 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-7pmsj"] Jun 11 00:14:20.467005 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:14:20.466964 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b61c15a_f271_471f_ae9b_ea0e30850103.slice/crio-accbd1837c487e1f46357fbdb4190675a00b7ec473625f2d4b1f7f73d64d5609 WatchSource:0}: Error finding container accbd1837c487e1f46357fbdb4190675a00b7ec473625f2d4b1f7f73d64d5609: Status 404 returned error can't find the container with id accbd1837c487e1f46357fbdb4190675a00b7ec473625f2d4b1f7f73d64d5609 Jun 11 00:14:20.512552 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.512472 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-2c4ph"] Jun 11 00:14:20.514699 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:14:20.514671 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00c5e59_da83_47d4_80dc_2c37e8a77788.slice/crio-c066d3683722d9f52266fd5f9211a56263f1779812e21f9bc7b2d05f76450aab WatchSource:0}: Error finding container c066d3683722d9f52266fd5f9211a56263f1779812e21f9bc7b2d05f76450aab: Status 404 returned error can't find the container with id c066d3683722d9f52266fd5f9211a56263f1779812e21f9bc7b2d05f76450aab Jun 11 00:14:20.699646 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.699553 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" event={"ID":"2b61c15a-f271-471f-ae9b-ea0e30850103","Type":"ContainerStarted","Data":"accbd1837c487e1f46357fbdb4190675a00b7ec473625f2d4b1f7f73d64d5609"} Jun 11 00:14:20.700687 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:20.700661 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" event={"ID":"a00c5e59-da83-47d4-80dc-2c37e8a77788","Type":"ContainerStarted","Data":"c066d3683722d9f52266fd5f9211a56263f1779812e21f9bc7b2d05f76450aab"} Jun 11 00:14:23.724503 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.724469 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" event={"ID":"2b61c15a-f271-471f-ae9b-ea0e30850103","Type":"ContainerStarted","Data":"7e5d2e2381e8604d4effdffdcb35bb15b45bc8fd77d48185e5c58f46cf5f7e1a"} Jun 11 00:14:23.724973 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.724601 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:14:23.726101 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.726079 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" event={"ID":"a00c5e59-da83-47d4-80dc-2c37e8a77788","Type":"ContainerStarted","Data":"fdf953baa92b8f4123ce3d0645cc0ba9b1b6bcfa322390192e3bce2f3c6ea585"} Jun 11 00:14:23.726199 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.726170 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:23.737868 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.737815 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" podStartSLOduration=2.346021797 podStartE2EDuration="4.73780034s" totalImagesPullingTime="2.391778543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:14:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:14:23.737329494 +0000 UTC m=+794.771706029" watchObservedRunningTime="2026-06-11 00:14:23.73780034 +0000 UTC m=+794.772176898" Jun 11 00:14:23.756903 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:23.756863 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" podStartSLOduration=1.421058535 podStartE2EDuration="3.756849897s" totalImagesPullingTime="2.335791362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:14:23.755120531 +0000 UTC m=+794.789497078" watchObservedRunningTime="2026-06-11 00:14:23.756849897 +0000 UTC m=+794.791226451" Jun 11 00:14:34.733379 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:34.733293 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-2c4ph" Jun 11 00:14:34.733736 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:14:34.733480 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-7pmsj" Jun 11 00:15:00.133217 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.133183 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29685615-5xz9z"] Jun 11 00:15:00.135484 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.135468 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:00.137791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.137775 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rp2gw\"" Jun 11 00:15:00.144000 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.143969 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685615-5xz9z"] Jun 11 00:15:00.190084 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.190061 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz4rm\" (UniqueName: \"kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm\") pod \"maas-api-key-cleanup-29685615-5xz9z\" (UID: \"7605ca60-bd46-40c8-9d32-e59e3189f93f\") " pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:00.290883 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.290850 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz4rm\" (UniqueName: \"kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm\") pod \"maas-api-key-cleanup-29685615-5xz9z\" (UID: \"7605ca60-bd46-40c8-9d32-e59e3189f93f\") " pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:00.299017 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.298993 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz4rm\" (UniqueName: \"kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm\") pod \"maas-api-key-cleanup-29685615-5xz9z\" (UID: \"7605ca60-bd46-40c8-9d32-e59e3189f93f\") " pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:00.446567 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.446476 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:00.571334 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.571302 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29685615-5xz9z"] Jun 11 00:15:00.573177 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:15:00.573142 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7605ca60_bd46_40c8_9d32_e59e3189f93f.slice/crio-ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e WatchSource:0}: Error finding container ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e: Status 404 returned error can't find the container with id ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e Jun 11 00:15:00.906297 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:00.906262 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" event={"ID":"7605ca60-bd46-40c8-9d32-e59e3189f93f","Type":"ContainerStarted","Data":"ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e"} Jun 11 00:15:03.925596 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:03.925559 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" event={"ID":"7605ca60-bd46-40c8-9d32-e59e3189f93f","Type":"ContainerStarted","Data":"aa5c2699593b4913798fc0c0563e6c837c254a02972f64834634b34c0aace8c7"} Jun 11 00:15:03.939625 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:03.939578 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" podStartSLOduration=0.905703197 podStartE2EDuration="3.939561312s" totalImagesPullingTime="3.033858115s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:15:03.938083344 +0000 UTC m=+834.972459897" watchObservedRunningTime="2026-06-11 00:15:03.939561312 +0000 UTC m=+834.973937865" Jun 11 00:15:04.931971 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:04.931937 2558 generic.go:356] "Generic (PLEG): container finished" podID="7605ca60-bd46-40c8-9d32-e59e3189f93f" containerID="aa5c2699593b4913798fc0c0563e6c837c254a02972f64834634b34c0aace8c7" exitCode=0 Jun 11 00:15:04.932361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:04.932017 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" event={"ID":"7605ca60-bd46-40c8-9d32-e59e3189f93f","Type":"ContainerDied","Data":"aa5c2699593b4913798fc0c0563e6c837c254a02972f64834634b34c0aace8c7"} Jun 11 00:15:06.067082 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.067060 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:15:06.138957 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.138926 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fz4rm\" (UniqueName: \"kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm\") pod \"7605ca60-bd46-40c8-9d32-e59e3189f93f\" (UID: \"7605ca60-bd46-40c8-9d32-e59e3189f93f\") " Jun 11 00:15:06.140821 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.140799 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm" (OuterVolumeSpecName: "kube-api-access-fz4rm") pod "7605ca60-bd46-40c8-9d32-e59e3189f93f" (UID: "7605ca60-bd46-40c8-9d32-e59e3189f93f"). InnerVolumeSpecName "kube-api-access-fz4rm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:15:06.239977 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.239920 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fz4rm\" (UniqueName: \"kubernetes.io/projected/7605ca60-bd46-40c8-9d32-e59e3189f93f-kube-api-access-fz4rm\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:15:06.943209 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.943176 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" event={"ID":"7605ca60-bd46-40c8-9d32-e59e3189f93f","Type":"ContainerDied","Data":"ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e"} Jun 11 00:15:06.943394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.943227 2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddcf283456840cbe323794d654f4dc1fef1256171b9bebc39b6c890ff1cb4c0e" Jun 11 00:15:06.943394 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:15:06.943190 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29685615-5xz9z" Jun 11 00:16:09.430552 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:09.430473 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:16:09.438566 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:09.438546 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:16:34.078752 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:34.078716 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:34.079245 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:34.078897 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" containerID="cri-o://a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0" gracePeriod=30 Jun 11 00:16:36.131686 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.131662 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.208506 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.208478 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddl5q\" (UniqueName: \"kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q\") pod \"de9fd567-238d-4327-9842-0d8b5306b378\" (UID: \"de9fd567-238d-4327-9842-0d8b5306b378\") " Jun 11 00:16:36.210564 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.210539 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q" (OuterVolumeSpecName: "kube-api-access-ddl5q") pod "de9fd567-238d-4327-9842-0d8b5306b378" (UID: "de9fd567-238d-4327-9842-0d8b5306b378"). InnerVolumeSpecName "kube-api-access-ddl5q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:16:36.309927 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.309894 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddl5q\" (UniqueName: \"kubernetes.io/projected/de9fd567-238d-4327-9842-0d8b5306b378-kube-api-access-ddl5q\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:16:36.380700 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.380662 2558 generic.go:356] "Generic (PLEG): container finished" podID="de9fd567-238d-4327-9842-0d8b5306b378" containerID="a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0" exitCode=143 Jun 11 00:16:36.380862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.380706 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.380862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.380745 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"de9fd567-238d-4327-9842-0d8b5306b378","Type":"ContainerDied","Data":"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0"} Jun 11 00:16:36.380862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.380804 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"de9fd567-238d-4327-9842-0d8b5306b378","Type":"ContainerDied","Data":"34f8407544b78f37c8bfe9f0e88d2a1493e77d7760f555287c5ad4b07ff4ea23"} Jun 11 00:16:36.380862 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.380826 2558 scope.go:117] "RemoveContainer" containerID="a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0" Jun 11 00:16:36.390151 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.390133 2558 scope.go:117] "RemoveContainer" containerID="a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0" Jun 11 00:16:36.390399 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:16:36.390380 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0\": container with ID starting with a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0 not found: ID does not exist" containerID="a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0" Jun 11 00:16:36.390491 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.390406 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0"} err="failed to get container status \"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0\": rpc error: code = NotFound desc = could not find container \"a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0\": container with ID starting with a83643a5a77e3ddce26d7c3523e9cf93ed507a603a76cae3d392fc21557360a0 not found: ID does not exist" Jun 11 00:16:36.401883 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.401860 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:36.406061 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.406040 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:36.428751 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.428728 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:36.429070 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429058 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" Jun 11 00:16:36.429112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429072 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" Jun 11 00:16:36.429112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429083 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7605ca60-bd46-40c8-9d32-e59e3189f93f" containerName="cleanup" Jun 11 00:16:36.429112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429089 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7605ca60-bd46-40c8-9d32-e59e3189f93f" containerName="cleanup" Jun 11 00:16:36.429204 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429152 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="de9fd567-238d-4327-9842-0d8b5306b378" containerName="keycloak" Jun 11 00:16:36.429204 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.429160 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7605ca60-bd46-40c8-9d32-e59e3189f93f" containerName="cleanup" Jun 11 00:16:36.433336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.433312 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.435677 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.435652 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 00:16:36.435776 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.435692 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-k6vv2\"" Jun 11 00:16:36.435776 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.435718 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 00:16:36.435776 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.435740 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 00:16:36.436133 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.435877 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 00:16:36.441735 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.441717 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:36.511791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.511770 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mpk\" (UniqueName: \"kubernetes.io/projected/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-kube-api-access-87mpk\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.511916 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.511813 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-test-realms\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.613336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.613244 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mpk\" (UniqueName: \"kubernetes.io/projected/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-kube-api-access-87mpk\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.613336 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.613301 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-test-realms\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.613923 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.613905 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-test-realms\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.620813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.620793 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mpk\" (UniqueName: \"kubernetes.io/projected/9bbf4249-b7d3-4300-9af0-cfd0942b3fc9-kube-api-access-87mpk\") pod \"maas-keycloak-0\" (UID: \"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9\") " pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.744221 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.744190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:36.871785 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:36.871758 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 00:16:36.874156 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:16:36.874126 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bbf4249_b7d3_4300_9af0_cfd0942b3fc9.slice/crio-959b26ff733de48b6874b5aca3fca64478e139940b612efa37b0c27248e7cc7e WatchSource:0}: Error finding container 959b26ff733de48b6874b5aca3fca64478e139940b612efa37b0c27248e7cc7e: Status 404 returned error can't find the container with id 959b26ff733de48b6874b5aca3fca64478e139940b612efa37b0c27248e7cc7e Jun 11 00:16:37.388174 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.388139 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9","Type":"ContainerStarted","Data":"bbb3bb5c5c74a231ab0978e10dc27181f249b42b023bcc4cee893c96afa12615"} Jun 11 00:16:37.388684 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.388195 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"9bbf4249-b7d3-4300-9af0-cfd0942b3fc9","Type":"ContainerStarted","Data":"959b26ff733de48b6874b5aca3fca64478e139940b612efa37b0c27248e7cc7e"} Jun 11 00:16:37.406651 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.406585 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.105296211 podStartE2EDuration="1.406565165s" totalImagesPullingTime="301.268954ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:16:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:16:37.405200368 +0000 UTC m=+928.439576923" watchObservedRunningTime="2026-06-11 00:16:37.406565165 +0000 UTC m=+928.440941720" Jun 11 00:16:37.427913 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.427821 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de9fd567-238d-4327-9842-0d8b5306b378" path="/var/lib/kubelet/pods/de9fd567-238d-4327-9842-0d8b5306b378/volumes" Jun 11 00:16:37.745008 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.744923 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:37.746789 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:37.746755 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:38.745563 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:38.745509 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:39.745626 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:39.745574 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:40.744991 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:40.744939 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:41.744754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:41.744707 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:42.745756 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:42.745710 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:43.745094 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:43.745041 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:44.745289 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:44.745240 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:45.744996 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:45.744949 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:46.744996 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:46.744949 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:46.745536 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:46.745253 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:47.745574 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:47.745521 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:48.745304 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:48.745251 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:49.745528 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:49.745451 2558 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.42:9000/health/started\": dial tcp 10.133.0.42:9000: connect: connection refused" Jun 11 00:16:50.855978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:50.855927 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 00:16:50.873010 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:16:50.872945 2558 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="9bbf4249-b7d3-4300-9af0-cfd0942b3fc9" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 00:17:00.862164 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:00.862132 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 00:17:11.559230 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.559194 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:17:11.564072 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.564050 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.566572 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.566470 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 00:17:11.569346 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.569315 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:17:11.664920 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.664892 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs4wx\" (UniqueName: \"kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.665064 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.664940 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.665064 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.664966 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.765445 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.765389 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs4wx\" (UniqueName: \"kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.765638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.765475 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.765638 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.765505 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.766097 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.766077 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.767908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.767883 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.772285 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.772265 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs4wx\" (UniqueName: \"kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx\") pod \"authorino-6457844b45-8q7cg\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:11.874554 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:11.874494 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:17:12.001858 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.001836 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:17:12.003681 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:17:12.003653 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b7de95e_6a96_4720_b862_19233ca6f9ea.slice/crio-bc8b2691b39601b74b9fedf933aa5ccc0ee701d34ca7604d2b42ee8e4fb60f7f WatchSource:0}: Error finding container bc8b2691b39601b74b9fedf933aa5ccc0ee701d34ca7604d2b42ee8e4fb60f7f: Status 404 returned error can't find the container with id bc8b2691b39601b74b9fedf933aa5ccc0ee701d34ca7604d2b42ee8e4fb60f7f Jun 11 00:17:12.604548 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.604516 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6457844b45-8q7cg" event={"ID":"9b7de95e-6a96-4720-b862-19233ca6f9ea","Type":"ContainerStarted","Data":"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136"} Jun 11 00:17:12.604929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.604559 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6457844b45-8q7cg" event={"ID":"9b7de95e-6a96-4720-b862-19233ca6f9ea","Type":"ContainerStarted","Data":"bc8b2691b39601b74b9fedf933aa5ccc0ee701d34ca7604d2b42ee8e4fb60f7f"} Jun 11 00:17:12.621229 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.621139 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6457844b45-8q7cg" podStartSLOduration=1.254431 podStartE2EDuration="1.621123777s" totalImagesPullingTime="366.692777ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:17:12.61944939 +0000 UTC m=+963.653825944" watchObservedRunningTime="2026-06-11 00:17:12.621123777 +0000 UTC m=+963.655500330" Jun 11 00:17:12.648894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.648859 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:17:12.649361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.649039 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7774957bd9-46lgg" podUID="dfcf3228-96a1-4a00-be5d-3135689fcc20" containerName="authorino" containerID="cri-o://ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df" gracePeriod=30 Jun 11 00:17:12.901087 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.901065 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:17:12.975811 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.975780 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txzkf\" (UniqueName: \"kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf\") pod \"dfcf3228-96a1-4a00-be5d-3135689fcc20\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " Jun 11 00:17:12.975956 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.975815 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert\") pod \"dfcf3228-96a1-4a00-be5d-3135689fcc20\" (UID: \"dfcf3228-96a1-4a00-be5d-3135689fcc20\") " Jun 11 00:17:12.977894 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.977871 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf" (OuterVolumeSpecName: "kube-api-access-txzkf") pod "dfcf3228-96a1-4a00-be5d-3135689fcc20" (UID: "dfcf3228-96a1-4a00-be5d-3135689fcc20"). InnerVolumeSpecName "kube-api-access-txzkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:17:12.985831 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:12.985808 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "dfcf3228-96a1-4a00-be5d-3135689fcc20" (UID: "dfcf3228-96a1-4a00-be5d-3135689fcc20"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:17:13.076806 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.076770 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txzkf\" (UniqueName: \"kubernetes.io/projected/dfcf3228-96a1-4a00-be5d-3135689fcc20-kube-api-access-txzkf\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:17:13.076806 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.076800 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dfcf3228-96a1-4a00-be5d-3135689fcc20-tls-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:17:13.610951 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.610916 2558 generic.go:356] "Generic (PLEG): container finished" podID="dfcf3228-96a1-4a00-be5d-3135689fcc20" containerID="ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df" exitCode=0 Jun 11 00:17:13.611376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.610975 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7774957bd9-46lgg" Jun 11 00:17:13.611376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.610964 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774957bd9-46lgg" event={"ID":"dfcf3228-96a1-4a00-be5d-3135689fcc20","Type":"ContainerDied","Data":"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df"} Jun 11 00:17:13.611376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.611084 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7774957bd9-46lgg" event={"ID":"dfcf3228-96a1-4a00-be5d-3135689fcc20","Type":"ContainerDied","Data":"299bc527cc25b9a993bd01a053dd60cf4eca414288880f5f80093dfd72ae26c5"} Jun 11 00:17:13.611376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.611108 2558 scope.go:117] "RemoveContainer" containerID="ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df" Jun 11 00:17:13.619631 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.619614 2558 scope.go:117] "RemoveContainer" containerID="ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df" Jun 11 00:17:13.619865 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:17:13.619849 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df\": container with ID starting with ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df not found: ID does not exist" containerID="ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df" Jun 11 00:17:13.619921 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.619873 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df"} err="failed to get container status \"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df\": rpc error: code = NotFound desc = could not find container \"ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df\": container with ID starting with ed14f3f261f5ec1032e57446ed757141ffbbf0a1d554077a51b23ea9523e06df not found: ID does not exist" Jun 11 00:17:13.625992 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.625956 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:17:13.627985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:13.627962 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7774957bd9-46lgg"] Jun 11 00:17:15.427552 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:15.427520 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfcf3228-96a1-4a00-be5d-3135689fcc20" path="/var/lib/kubelet/pods/dfcf3228-96a1-4a00-be5d-3135689fcc20/volumes" Jun 11 00:17:18.496373 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.496338 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9"] Jun 11 00:17:18.496954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.496931 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfcf3228-96a1-4a00-be5d-3135689fcc20" containerName="authorino" Jun 11 00:17:18.497007 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.496958 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfcf3228-96a1-4a00-be5d-3135689fcc20" containerName="authorino" Jun 11 00:17:18.497075 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.497063 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfcf3228-96a1-4a00-be5d-3135689fcc20" containerName="authorino" Jun 11 00:17:18.502215 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.502190 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.505781 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.505757 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 00:17:18.505910 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.505782 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c8wdk\"" Jun 11 00:17:18.505910 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.505757 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 00:17:18.505910 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.505757 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 00:17:18.511740 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.511716 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9"] Jun 11 00:17:18.524847 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.524807 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.524978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.524941 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.525044 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.524989 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.525107 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.525082 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e37f80-c063-4dbb-8795-ea2bd9260341-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.525201 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.525173 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.525310 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.525210 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvx6\" (UniqueName: \"kubernetes.io/projected/b4e37f80-c063-4dbb-8795-ea2bd9260341-kube-api-access-mbvx6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626727 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626692 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626732 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626753 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626772 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e37f80-c063-4dbb-8795-ea2bd9260341-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626805 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.626880 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.626820 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvx6\" (UniqueName: \"kubernetes.io/projected/b4e37f80-c063-4dbb-8795-ea2bd9260341-kube-api-access-mbvx6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.627177 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.627151 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.627241 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.627200 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.627290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.627274 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.628827 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.628801 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b4e37f80-c063-4dbb-8795-ea2bd9260341-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.629303 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.629283 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b4e37f80-c063-4dbb-8795-ea2bd9260341-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.634087 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.634069 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvx6\" (UniqueName: \"kubernetes.io/projected/b4e37f80-c063-4dbb-8795-ea2bd9260341-kube-api-access-mbvx6\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9\" (UID: \"b4e37f80-c063-4dbb-8795-ea2bd9260341\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.815116 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.815079 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:17:18.958306 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.958281 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9"] Jun 11 00:17:18.960576 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:17:18.960533 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4e37f80_c063_4dbb_8795_ea2bd9260341.slice/crio-832d99db314790a5f1134c6f412bd3f79d78715e345d1b44f1c8eb15fb5000dc WatchSource:0}: Error finding container 832d99db314790a5f1134c6f412bd3f79d78715e345d1b44f1c8eb15fb5000dc: Status 404 returned error can't find the container with id 832d99db314790a5f1134c6f412bd3f79d78715e345d1b44f1c8eb15fb5000dc Jun 11 00:17:18.962576 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:18.962555 2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 00:17:19.644005 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:19.643967 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" event={"ID":"b4e37f80-c063-4dbb-8795-ea2bd9260341","Type":"ContainerStarted","Data":"832d99db314790a5f1134c6f412bd3f79d78715e345d1b44f1c8eb15fb5000dc"} Jun 11 00:17:23.665623 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:17:23.665589 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" event={"ID":"b4e37f80-c063-4dbb-8795-ea2bd9260341","Type":"ContainerStarted","Data":"66b334594a5bb597c2cdb244f6daa9316094ebfe66e9f345709c316ad3e528c6"} Jun 11 00:18:13.502265 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.502231 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw"] Jun 11 00:18:13.506929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.506911 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.509829 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.509807 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 00:18:13.518114 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.518091 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw"] Jun 11 00:18:13.601480 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601444 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.601650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601509 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.601650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601528 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c702171b-3a5e-4d01-ad7e-1a5da280a6be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.601650 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601544 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.601813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601648 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9vfh\" (UniqueName: \"kubernetes.io/projected/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kube-api-access-m9vfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.601813 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.601701 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703017 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.702981 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703017 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703020 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c702171b-3a5e-4d01-ad7e-1a5da280a6be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703228 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703038 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703228 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703093 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9vfh\" (UniqueName: \"kubernetes.io/projected/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kube-api-access-m9vfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703228 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703130 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703228 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703183 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703485 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703461 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703565 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703523 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.703619 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.703594 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.705498 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.705467 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c702171b-3a5e-4d01-ad7e-1a5da280a6be-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.705740 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.705721 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c702171b-3a5e-4d01-ad7e-1a5da280a6be-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.710631 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.710611 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9vfh\" (UniqueName: \"kubernetes.io/projected/c702171b-3a5e-4d01-ad7e-1a5da280a6be-kube-api-access-m9vfh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw\" (UID: \"c702171b-3a5e-4d01-ad7e-1a5da280a6be\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.818592 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.818514 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:13.950503 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:13.950473 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw"] Jun 11 00:18:13.951813 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:18:13.951784 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc702171b_3a5e_4d01_ad7e_1a5da280a6be.slice/crio-e6b2080aec3e9f4067245a147bcdf171c8250b4a2cb9cb733bb503e660a50de0 WatchSource:0}: Error finding container e6b2080aec3e9f4067245a147bcdf171c8250b4a2cb9cb733bb503e660a50de0: Status 404 returned error can't find the container with id e6b2080aec3e9f4067245a147bcdf171c8250b4a2cb9cb733bb503e660a50de0 Jun 11 00:18:14.906768 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:14.906722 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" event={"ID":"c702171b-3a5e-4d01-ad7e-1a5da280a6be","Type":"ContainerStarted","Data":"98e67a61d8c5696d1d7d87393231ac50589f52dace21ac82b036f1093ca80b59"} Jun 11 00:18:14.907346 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:14.906796 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" event={"ID":"c702171b-3a5e-4d01-ad7e-1a5da280a6be","Type":"ContainerStarted","Data":"e6b2080aec3e9f4067245a147bcdf171c8250b4a2cb9cb733bb503e660a50de0"} Jun 11 00:18:15.912671 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:15.912639 2558 generic.go:356] "Generic (PLEG): container finished" podID="c702171b-3a5e-4d01-ad7e-1a5da280a6be" containerID="98e67a61d8c5696d1d7d87393231ac50589f52dace21ac82b036f1093ca80b59" exitCode=0 Jun 11 00:18:15.913033 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:15.912721 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" event={"ID":"c702171b-3a5e-4d01-ad7e-1a5da280a6be","Type":"ContainerDied","Data":"98e67a61d8c5696d1d7d87393231ac50589f52dace21ac82b036f1093ca80b59"} Jun 11 00:18:17.924131 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:17.924043 2558 generic.go:356] "Generic (PLEG): container finished" podID="b4e37f80-c063-4dbb-8795-ea2bd9260341" containerID="66b334594a5bb597c2cdb244f6daa9316094ebfe66e9f345709c316ad3e528c6" exitCode=0 Jun 11 00:18:17.924560 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:17.924120 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" event={"ID":"b4e37f80-c063-4dbb-8795-ea2bd9260341","Type":"ContainerDied","Data":"66b334594a5bb597c2cdb244f6daa9316094ebfe66e9f345709c316ad3e528c6"} Jun 11 00:18:17.926078 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:17.926051 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" event={"ID":"c702171b-3a5e-4d01-ad7e-1a5da280a6be","Type":"ContainerStarted","Data":"c0674af1e7b24ad323e51f3d3603092447e0ef42e04fbc123c2b68f5f031a815"} Jun 11 00:18:17.956712 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:17.956659 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" podStartSLOduration=2.560076929 podStartE2EDuration="4.956643598s" totalImagesPullingTime="1.061859654s" totalInitContainerRuntime="1.334707015s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:18:17.955287873 +0000 UTC m=+1028.989664439" watchObservedRunningTime="2026-06-11 00:18:17.956643598 +0000 UTC m=+1028.991020151" Jun 11 00:18:18.933360 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:18.933327 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" event={"ID":"b4e37f80-c063-4dbb-8795-ea2bd9260341","Type":"ContainerStarted","Data":"e3317e68e00593f1fa06c024a8e04d3b0f29577b80a6cc17ae8db87d0ff88a82"} Jun 11 00:18:18.949436 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:18.949380 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" podStartSLOduration=2.169098591 podStartE2EDuration="1m0.949364732s" totalImagesPullingTime="4.361187196s" totalInitContainerRuntime="54.419078945s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:17:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:18:18.9484707 +0000 UTC m=+1029.982847254" watchObservedRunningTime="2026-06-11 00:18:18.949364732 +0000 UTC m=+1029.983741344" Jun 11 00:18:22.268200 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.268166 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9"] Jun 11 00:18:22.274089 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.274066 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.276546 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.276519 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 00:18:22.280465 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.280441 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9"] Jun 11 00:18:22.381551 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381513 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0afec59-69dc-46dc-9bdd-d4acf1383412-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.381700 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381562 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.381700 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381588 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sljg\" (UniqueName: \"kubernetes.io/projected/e0afec59-69dc-46dc-9bdd-d4acf1383412-kube-api-access-8sljg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.381700 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381666 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.381818 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381725 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.381818 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.381762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482437 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482390 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482450 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482478 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482500 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0afec59-69dc-46dc-9bdd-d4acf1383412-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482524 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482603 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482547 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sljg\" (UniqueName: \"kubernetes.io/projected/e0afec59-69dc-46dc-9bdd-d4acf1383412-kube-api-access-8sljg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482867 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.482929 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482902 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.483005 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.482938 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.484791 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.484768 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0afec59-69dc-46dc-9bdd-d4acf1383412-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.484883 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.484857 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0afec59-69dc-46dc-9bdd-d4acf1383412-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.489586 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.489564 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sljg\" (UniqueName: \"kubernetes.io/projected/e0afec59-69dc-46dc-9bdd-d4acf1383412-kube-api-access-8sljg\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9\" (UID: \"e0afec59-69dc-46dc-9bdd-d4acf1383412\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.586363 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.586301 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:22.716254 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.716230 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9"] Jun 11 00:18:22.718167 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:18:22.718135 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0afec59_69dc_46dc_9bdd_d4acf1383412.slice/crio-65ce9e2d74cef45e18dc8be7008f9e18a1e59364e391491c9c3d2ef3ca4f1712 WatchSource:0}: Error finding container 65ce9e2d74cef45e18dc8be7008f9e18a1e59364e391491c9c3d2ef3ca4f1712: Status 404 returned error can't find the container with id 65ce9e2d74cef45e18dc8be7008f9e18a1e59364e391491c9c3d2ef3ca4f1712 Jun 11 00:18:22.955750 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.955663 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" event={"ID":"e0afec59-69dc-46dc-9bdd-d4acf1383412","Type":"ContainerStarted","Data":"87ff7ee4de931a8290aaf20466787af1e29c100b8479919a61d7292597a23cdf"} Jun 11 00:18:22.955750 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:22.955727 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" event={"ID":"e0afec59-69dc-46dc-9bdd-d4acf1383412","Type":"ContainerStarted","Data":"65ce9e2d74cef45e18dc8be7008f9e18a1e59364e391491c9c3d2ef3ca4f1712"} Jun 11 00:18:23.818999 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:23.818967 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:23.819361 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:23.819024 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:23.831490 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:23.831467 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:23.971751 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:23.971721 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw" Jun 11 00:18:24.966949 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:24.966916 2558 generic.go:356] "Generic (PLEG): container finished" podID="e0afec59-69dc-46dc-9bdd-d4acf1383412" containerID="87ff7ee4de931a8290aaf20466787af1e29c100b8479919a61d7292597a23cdf" exitCode=0 Jun 11 00:18:24.967313 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:24.966992 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" event={"ID":"e0afec59-69dc-46dc-9bdd-d4acf1383412","Type":"ContainerDied","Data":"87ff7ee4de931a8290aaf20466787af1e29c100b8479919a61d7292597a23cdf"} Jun 11 00:18:25.973224 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:25.973189 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" event={"ID":"e0afec59-69dc-46dc-9bdd-d4acf1383412","Type":"ContainerStarted","Data":"b1bf3d9351f02f537c6b9e005cc7eb2814d96a5b1c5c05e6e346a8595e1bfffe"} Jun 11 00:18:25.989148 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:25.989097 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" podStartSLOduration=2.443895251 podStartE2EDuration="3.989081671s" totalImagesPullingTime="180.140378ms" totalInitContainerRuntime="1.365046042s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:18:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:18:25.987714733 +0000 UTC m=+1037.022091289" watchObservedRunningTime="2026-06-11 00:18:25.989081671 +0000 UTC m=+1037.023458261" Jun 11 00:18:28.815528 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:28.815493 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:18:28.816020 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:28.815560 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:18:28.828043 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:28.828015 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:18:28.998471 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:28.998443 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9" Jun 11 00:18:32.586794 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:32.586747 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:32.587270 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:32.586823 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:32.599710 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:32.599684 2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:18:33.018125 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:18:33.018090 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9" Jun 11 00:20:01.971727 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:01.971692 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-556d946d64-n6dlf"] Jun 11 00:20:01.974978 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:01.974959 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:01.981653 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:01.981627 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-556d946d64-n6dlf"] Jun 11 00:20:02.047121 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.047096 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-oidc-ca\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.047230 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.047148 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm2b6\" (UniqueName: \"kubernetes.io/projected/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-kube-api-access-bm2b6\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.047230 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.047175 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-tls-cert\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.148411 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.148382 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-oidc-ca\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.148548 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.148452 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bm2b6\" (UniqueName: \"kubernetes.io/projected/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-kube-api-access-bm2b6\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.148548 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.148470 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-tls-cert\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.149083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.149066 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-oidc-ca\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.150821 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.150800 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-tls-cert\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.156599 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.156578 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm2b6\" (UniqueName: \"kubernetes.io/projected/d25ea3d1-3473-4f8e-b93e-ad31d127efbd-kube-api-access-bm2b6\") pod \"authorino-556d946d64-n6dlf\" (UID: \"d25ea3d1-3473-4f8e-b93e-ad31d127efbd\") " pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.285711 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.285674 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-556d946d64-n6dlf" Jun 11 00:20:02.417299 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.417266 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-556d946d64-n6dlf"] Jun 11 00:20:02.418487 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:20:02.418448 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd25ea3d1_3473_4f8e_b93e_ad31d127efbd.slice/crio-d8ec4136e218a02a716a59cb666811ab332d8482df292ab14f2e76ee6231c243 WatchSource:0}: Error finding container d8ec4136e218a02a716a59cb666811ab332d8482df292ab14f2e76ee6231c243: Status 404 returned error can't find the container with id d8ec4136e218a02a716a59cb666811ab332d8482df292ab14f2e76ee6231c243 Jun 11 00:20:02.449804 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:02.449775 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-556d946d64-n6dlf" event={"ID":"d25ea3d1-3473-4f8e-b93e-ad31d127efbd","Type":"ContainerStarted","Data":"d8ec4136e218a02a716a59cb666811ab332d8482df292ab14f2e76ee6231c243"} Jun 11 00:20:03.458533 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.458491 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-556d946d64-n6dlf" event={"ID":"d25ea3d1-3473-4f8e-b93e-ad31d127efbd","Type":"ContainerStarted","Data":"afdcbfc92f0c1dbe530f823aa424cd08fb2fcdf1d5d3edf623a784af3806bd45"} Jun 11 00:20:03.474665 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.474596 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-556d946d64-n6dlf" podStartSLOduration=2.012329786 podStartE2EDuration="2.474574647s" totalImagesPullingTime="462.244861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:20:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:20:03.472364037 +0000 UTC m=+1134.506740591" watchObservedRunningTime="2026-06-11 00:20:03.474574647 +0000 UTC m=+1134.508951203" Jun 11 00:20:03.503103 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.503040 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:20:03.503290 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.503241 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6457844b45-8q7cg" podUID="9b7de95e-6a96-4720-b862-19233ca6f9ea" containerName="authorino" containerID="cri-o://af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136" gracePeriod=30 Jun 11 00:20:03.793746 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.793711 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:20:03.865970 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.865937 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca\") pod \"9b7de95e-6a96-4720-b862-19233ca6f9ea\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " Jun 11 00:20:03.866134 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.866049 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs4wx\" (UniqueName: \"kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx\") pod \"9b7de95e-6a96-4720-b862-19233ca6f9ea\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " Jun 11 00:20:03.866134 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.866084 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert\") pod \"9b7de95e-6a96-4720-b862-19233ca6f9ea\" (UID: \"9b7de95e-6a96-4720-b862-19233ca6f9ea\") " Jun 11 00:20:03.868294 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.868256 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx" (OuterVolumeSpecName: "kube-api-access-xs4wx") pod "9b7de95e-6a96-4720-b862-19233ca6f9ea" (UID: "9b7de95e-6a96-4720-b862-19233ca6f9ea"). InnerVolumeSpecName "kube-api-access-xs4wx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:20:03.871134 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.871108 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "9b7de95e-6a96-4720-b862-19233ca6f9ea" (UID: "9b7de95e-6a96-4720-b862-19233ca6f9ea"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 00:20:03.876083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.876061 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9b7de95e-6a96-4720-b862-19233ca6f9ea" (UID: "9b7de95e-6a96-4720-b862-19233ca6f9ea"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:20:03.967112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.967078 2558 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9b7de95e-6a96-4720-b862-19233ca6f9ea-oidc-ca\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:20:03.967112 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.967109 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs4wx\" (UniqueName: \"kubernetes.io/projected/9b7de95e-6a96-4720-b862-19233ca6f9ea-kube-api-access-xs4wx\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:20:03.967302 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:03.967122 2558 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9b7de95e-6a96-4720-b862-19233ca6f9ea-tls-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:20:04.464919 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.464828 2558 generic.go:356] "Generic (PLEG): container finished" podID="9b7de95e-6a96-4720-b862-19233ca6f9ea" containerID="af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136" exitCode=0 Jun 11 00:20:04.464919 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.464904 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6457844b45-8q7cg" Jun 11 00:20:04.465395 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.464926 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6457844b45-8q7cg" event={"ID":"9b7de95e-6a96-4720-b862-19233ca6f9ea","Type":"ContainerDied","Data":"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136"} Jun 11 00:20:04.465395 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.464965 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6457844b45-8q7cg" event={"ID":"9b7de95e-6a96-4720-b862-19233ca6f9ea","Type":"ContainerDied","Data":"bc8b2691b39601b74b9fedf933aa5ccc0ee701d34ca7604d2b42ee8e4fb60f7f"} Jun 11 00:20:04.465395 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.464982 2558 scope.go:117] "RemoveContainer" containerID="af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136" Jun 11 00:20:04.481391 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.481374 2558 scope.go:117] "RemoveContainer" containerID="af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136" Jun 11 00:20:04.481658 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:20:04.481638 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136\": container with ID starting with af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136 not found: ID does not exist" containerID="af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136" Jun 11 00:20:04.481753 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.481666 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136"} err="failed to get container status \"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136\": rpc error: code = NotFound desc = could not find container \"af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136\": container with ID starting with af5ff1476f0f9910b6c2026a34981b46f203d389b7aa8dfc12a590da4fcb4136 not found: ID does not exist" Jun 11 00:20:04.491789 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.491765 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:20:04.495504 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:04.495483 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6457844b45-8q7cg"] Jun 11 00:20:05.424941 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:20:05.424906 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b7de95e-6a96-4720-b862-19233ca6f9ea" path="/var/lib/kubelet/pods/9b7de95e-6a96-4720-b862-19233ca6f9ea/volumes" Jun 11 00:21:09.460380 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:09.460344 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:21:09.469540 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:09.469520 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:21:29.466198 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:29.466164 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:21:29.883093 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:29.883058 2558 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8467c765-njwqb" podUID="97cce07b-9511-452f-b57d-66a1ef07924a" containerName="manager" containerID="cri-o://bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58" gracePeriod=30 Jun 11 00:21:30.131008 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.130982 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:21:30.244353 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.244276 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlh5k\" (UniqueName: \"kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k\") pod \"97cce07b-9511-452f-b57d-66a1ef07924a\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " Jun 11 00:21:30.244517 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.244383 2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert\") pod \"97cce07b-9511-452f-b57d-66a1ef07924a\" (UID: \"97cce07b-9511-452f-b57d-66a1ef07924a\") " Jun 11 00:21:30.246368 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.246338 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "97cce07b-9511-452f-b57d-66a1ef07924a" (UID: "97cce07b-9511-452f-b57d-66a1ef07924a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 00:21:30.246503 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.246396 2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k" (OuterVolumeSpecName: "kube-api-access-zlh5k") pod "97cce07b-9511-452f-b57d-66a1ef07924a" (UID: "97cce07b-9511-452f-b57d-66a1ef07924a"). InnerVolumeSpecName "kube-api-access-zlh5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 00:21:30.345368 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.345336 2558 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/97cce07b-9511-452f-b57d-66a1ef07924a-webhook-cert\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:21:30.345368 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.345363 2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlh5k\" (UniqueName: \"kubernetes.io/projected/97cce07b-9511-452f-b57d-66a1ef07924a-kube-api-access-zlh5k\") on node \"ip-10-0-138-70.ec2.internal\" DevicePath \"\"" Jun 11 00:21:30.889908 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.889876 2558 generic.go:356] "Generic (PLEG): container finished" podID="97cce07b-9511-452f-b57d-66a1ef07924a" containerID="bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58" exitCode=0 Jun 11 00:21:30.890325 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.889916 2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-njwqb" Jun 11 00:21:30.890325 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.889962 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-njwqb" event={"ID":"97cce07b-9511-452f-b57d-66a1ef07924a","Type":"ContainerDied","Data":"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58"} Jun 11 00:21:30.890325 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.890006 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-njwqb" event={"ID":"97cce07b-9511-452f-b57d-66a1ef07924a","Type":"ContainerDied","Data":"2b33bd0074fc86ca6d697616d112848778d7a41f32447f430c595395ea3b2da8"} Jun 11 00:21:30.890325 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.890029 2558 scope.go:117] "RemoveContainer" containerID="bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58" Jun 11 00:21:30.899581 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.899564 2558 scope.go:117] "RemoveContainer" containerID="bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58" Jun 11 00:21:30.899831 ip-10-0-138-70 kubenswrapper[2558]: E0611 00:21:30.899813 2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58\": container with ID starting with bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58 not found: ID does not exist" containerID="bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58" Jun 11 00:21:30.899885 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.899838 2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58"} err="failed to get container status \"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58\": rpc error: code = NotFound desc = could not find container \"bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58\": container with ID starting with bf2900fe34dfef334cb53d6ebeffdb3dd79510fe057a2285ccf44d4ecaa88e58 not found: ID does not exist" Jun 11 00:21:30.910144 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.910121 2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:21:30.913275 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:30.913254 2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8467c765-njwqb"] Jun 11 00:21:31.424481 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.424449 2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97cce07b-9511-452f-b57d-66a1ef07924a" path="/var/lib/kubelet/pods/97cce07b-9511-452f-b57d-66a1ef07924a/volumes" Jun 11 00:21:31.635798 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.635766 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8467c765-cqj8b"] Jun 11 00:21:31.636160 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636148 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97cce07b-9511-452f-b57d-66a1ef07924a" containerName="manager" Jun 11 00:21:31.636210 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636162 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="97cce07b-9511-452f-b57d-66a1ef07924a" containerName="manager" Jun 11 00:21:31.636210 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636172 2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b7de95e-6a96-4720-b862-19233ca6f9ea" containerName="authorino" Jun 11 00:21:31.636210 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636177 2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b7de95e-6a96-4720-b862-19233ca6f9ea" containerName="authorino" Jun 11 00:21:31.636302 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636232 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="97cce07b-9511-452f-b57d-66a1ef07924a" containerName="manager" Jun 11 00:21:31.636302 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.636243 2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b7de95e-6a96-4720-b862-19233ca6f9ea" containerName="authorino" Jun 11 00:21:31.640404 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.640382 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.643966 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.643946 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 00:21:31.644083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.643983 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 00:21:31.644083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.643954 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x6gg9\"" Jun 11 00:21:31.647947 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.647918 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8467c765-cqj8b"] Jun 11 00:21:31.760162 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.760124 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp5ww\" (UniqueName: \"kubernetes.io/projected/f191bcd0-341d-4043-876e-70141d766d32-kube-api-access-zp5ww\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.760358 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.760240 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f191bcd0-341d-4043-876e-70141d766d32-webhook-cert\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.861651 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.861617 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp5ww\" (UniqueName: \"kubernetes.io/projected/f191bcd0-341d-4043-876e-70141d766d32-kube-api-access-zp5ww\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.861789 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.861686 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f191bcd0-341d-4043-876e-70141d766d32-webhook-cert\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.864001 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.863981 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f191bcd0-341d-4043-876e-70141d766d32-webhook-cert\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.869257 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.869229 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp5ww\" (UniqueName: \"kubernetes.io/projected/f191bcd0-341d-4043-876e-70141d766d32-kube-api-access-zp5ww\") pod \"maas-controller-5b8467c765-cqj8b\" (UID: \"f191bcd0-341d-4043-876e-70141d766d32\") " pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:31.951614 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:31.951577 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:32.081307 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:32.081283 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8467c765-cqj8b"] Jun 11 00:21:32.083859 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:21:32.083829 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf191bcd0_341d_4043_876e_70141d766d32.slice/crio-a657771ded3c9f65596f5a984216c8f4fad1627890e70b3d8b3a867922990662 WatchSource:0}: Error finding container a657771ded3c9f65596f5a984216c8f4fad1627890e70b3d8b3a867922990662: Status 404 returned error can't find the container with id a657771ded3c9f65596f5a984216c8f4fad1627890e70b3d8b3a867922990662 Jun 11 00:21:32.902795 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:32.902712 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-cqj8b" event={"ID":"f191bcd0-341d-4043-876e-70141d766d32","Type":"ContainerStarted","Data":"ad3096233afd517f1969eb24ed5e8197c4d32269cad0f2b60cf80928e48bdbd9"} Jun 11 00:21:32.902926 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:32.902811 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:21:32.902926 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:32.902837 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8467c765-cqj8b" event={"ID":"f191bcd0-341d-4043-876e-70141d766d32","Type":"ContainerStarted","Data":"a657771ded3c9f65596f5a984216c8f4fad1627890e70b3d8b3a867922990662"} Jun 11 00:21:32.919038 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:32.918991 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8467c765-cqj8b" podStartSLOduration=1.35808807 podStartE2EDuration="1.918975451s" totalImagesPullingTime="560.887381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 00:21:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:21:32.917832852 +0000 UTC m=+1223.952209406" watchObservedRunningTime="2026-06-11 00:21:32.918975451 +0000 UTC m=+1223.953352004" Jun 11 00:21:43.913537 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:21:43.913509 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8467c765-cqj8b" Jun 11 00:26:09.490155 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:26:09.490123 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:26:09.500480 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:26:09.500457 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:31:09.520277 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:31:09.520246 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:31:09.530544 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:31:09.530522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:36:09.549022 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:36:09.548995 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:36:09.561083 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:36:09.561061 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:41:09.579073 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:41:09.579044 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:41:09.592763 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:41:09.592742 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:42:25.152461 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:25.152409 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556d946d64-n6dlf_d25ea3d1-3473-4f8e-b93e-ad31d127efbd/authorino/0.log" Jun 11 00:42:29.829306 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:29.829268 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rqz4h_d8530f70-8bec-4637-ad40-2b86dbf7eaeb/manager/0.log" Jun 11 00:42:30.049507 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:30.049472 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685615-5xz9z_7605ca60-bd46-40c8-9d32-e59e3189f93f/cleanup/0.log" Jun 11 00:42:30.263835 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:30.263795 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b8467c765-cqj8b_f191bcd0-341d-4043-876e-70141d766d32/manager/0.log" Jun 11 00:42:30.376011 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:30.375984 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h4s6t_9f1c6f9f-985c-417d-b555-ad3545933c0d/server/0.log" Jun 11 00:42:30.825610 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:30.825590 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-948c7c79b-rldjm_c5e3e1c9-9faa-4abe-b161-8478125932dd/copy-manifests/0.log" Jun 11 00:42:30.831954 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:30.831927 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-948c7c79b-rldjm_c5e3e1c9-9faa-4abe-b161-8478125932dd/manager/0.log" Jun 11 00:42:32.152259 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:32.152214 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556d946d64-n6dlf_d25ea3d1-3473-4f8e-b93e-ad31d127efbd/authorino/0.log" Jun 11 00:42:33.636204 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:33.636168 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db9bd6bdc-nbdnr_c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa/kube-auth-proxy/0.log" Jun 11 00:42:33.859044 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:33.859020 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7pmsj_2b61c15a-f271-471f-ae9b-ea0e30850103/payload-pre-processing/0.log" Jun 11 00:42:33.966320 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:33.966253 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2c4ph_a00c5e59-da83-47d4-80dc-2c37e8a77788/payload-processing/0.log" Jun 11 00:42:34.068371 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.068345 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log" Jun 11 00:42:34.397869 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.397841 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9_b4e37f80-c063-4dbb-8795-ea2bd9260341/storage-initializer/0.log" Jun 11 00:42:34.404023 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.404002 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-94gw9_b4e37f80-c063-4dbb-8795-ea2bd9260341/main/0.log" Jun 11 00:42:34.748433 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.748347 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw_c702171b-3a5e-4d01-ad7e-1a5da280a6be/storage-initializer/0.log" Jun 11 00:42:34.754646 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.754622 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cd6nsw_c702171b-3a5e-4d01-ad7e-1a5da280a6be/main/0.log" Jun 11 00:42:34.861187 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.861163 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9_e0afec59-69dc-46dc-9bdd-d4acf1383412/storage-initializer/0.log" Jun 11 00:42:34.868074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:34.868054 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-mg8n9_e0afec59-69dc-46dc-9bdd-d4acf1383412/main/0.log" Jun 11 00:42:42.160819 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:42.160789 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rvrbw_84ff857a-d5d2-41b3-9876-5106e2f822bf/global-pull-secret-syncer/0.log" Jun 11 00:42:42.229867 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:42.229842 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-82tcd_a14161ea-8dbd-4030-bb1a-64387354a2d4/konnectivity-agent/0.log" Jun 11 00:42:42.296011 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:42.295992 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-70.ec2.internal_c1e0b09ec255377f0d61fd9741eb78d3/haproxy/0.log" Jun 11 00:42:47.026754 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:47.026728 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-556d946d64-n6dlf_d25ea3d1-3473-4f8e-b93e-ad31d127efbd/authorino/0.log" Jun 11 00:42:49.023471 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.023439 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/alertmanager/0.log" Jun 11 00:42:49.046193 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.046163 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/config-reloader/0.log" Jun 11 00:42:49.067623 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.067602 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/kube-rbac-proxy-web/0.log" Jun 11 00:42:49.086558 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.086538 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/kube-rbac-proxy/0.log" Jun 11 00:42:49.105226 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.105205 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/kube-rbac-proxy-metric/0.log" Jun 11 00:42:49.123906 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.123883 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/prom-label-proxy/0.log" Jun 11 00:42:49.142414 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.142389 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_deda78b5-de74-4b23-8759-80f77fb6ab1f/init-config-reloader/0.log" Jun 11 00:42:49.177937 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.177912 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-rvjpt_de7084ea-54d2-42ad-bc19-89702fad376f/cluster-monitoring-operator/0.log" Jun 11 00:42:49.201149 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.201124 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sdpcf_b2e8d43d-15e5-4d44-b191-f329f80686a0/kube-state-metrics/0.log" Jun 11 00:42:49.217708 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.217684 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sdpcf_b2e8d43d-15e5-4d44-b191-f329f80686a0/kube-rbac-proxy-main/0.log" Jun 11 00:42:49.238204 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.238181 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-sdpcf_b2e8d43d-15e5-4d44-b191-f329f80686a0/kube-rbac-proxy-self/0.log" Jun 11 00:42:49.488200 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.488126 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2kvx_ece35185-ae3a-4962-85d6-f36719ca4761/node-exporter/0.log" Jun 11 00:42:49.508483 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.508459 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2kvx_ece35185-ae3a-4962-85d6-f36719ca4761/kube-rbac-proxy/0.log" Jun 11 00:42:49.530040 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.530020 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-r2kvx_ece35185-ae3a-4962-85d6-f36719ca4761/init-textfile/0.log" Jun 11 00:42:49.938142 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.938113 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9cd7cb78-nqzm2_072e0065-992b-4244-81c6-74e9009b7c8c/telemeter-client/0.log" Jun 11 00:42:49.969521 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.969495 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9cd7cb78-nqzm2_072e0065-992b-4244-81c6-74e9009b7c8c/reload/0.log" Jun 11 00:42:49.987788 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:49.987765 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7c9cd7cb78-nqzm2_072e0065-992b-4244-81c6-74e9009b7c8c/kube-rbac-proxy/0.log" Jun 11 00:42:52.866588 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:52.866562 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-2729h_283b979d-a041-4bcd-b126-f6b6ba7f8c87/download-server/0.log" Jun 11 00:42:53.513895 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:53.513865 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-whxpm_d65cc772-f31f-4119-aa4b-7aa62a6fd0d7/volume-data-source-validator/0.log" Jun 11 00:42:54.032618 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.032584 2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz"] Jun 11 00:42:54.036234 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.036214 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.038551 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.038530 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9fw5\"/\"openshift-service-ca.crt\"" Jun 11 00:42:54.039630 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.039605 2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j9fw5\"/\"default-dockercfg-57fpr\"" Jun 11 00:42:54.039775 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.039682 2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j9fw5\"/\"kube-root-ca.crt\"" Jun 11 00:42:54.042798 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.042776 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz"] Jun 11 00:42:54.174760 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.174722 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-sys\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.174760 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.174762 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-proc\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.174965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.174784 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-podres\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.174965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.174827 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jclhq\" (UniqueName: \"kubernetes.io/projected/db563aaa-ff41-47a2-a30c-f3e7db20f679-kube-api-access-jclhq\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.174965 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.174937 2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-lib-modules\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275765 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275734 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-sys\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275765 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275765 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-proc\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275782 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-podres\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275802 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jclhq\" (UniqueName: \"kubernetes.io/projected/db563aaa-ff41-47a2-a30c-f3e7db20f679-kube-api-access-jclhq\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275846 2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-lib-modules\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275880 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-sys\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275889 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-proc\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275932 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-podres\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.275985 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.275969 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/db563aaa-ff41-47a2-a30c-f3e7db20f679-lib-modules\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.283365 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.283316 2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jclhq\" (UniqueName: \"kubernetes.io/projected/db563aaa-ff41-47a2-a30c-f3e7db20f679-kube-api-access-jclhq\") pod \"perf-node-gather-daemonset-66rcz\" (UID: \"db563aaa-ff41-47a2-a30c-f3e7db20f679\") " pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.347376 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.347343 2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:54.480457 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.480404 2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz"] Jun 11 00:42:54.484114 ip-10-0-138-70 kubenswrapper[2558]: W0611 00:42:54.484079 2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddb563aaa_ff41_47a2_a30c_f3e7db20f679.slice/crio-ac51c538b9fc76c7e7392a1e4bfab5ebe4728ea5faca3d5ed173726c0578e4ea WatchSource:0}: Error finding container ac51c538b9fc76c7e7392a1e4bfab5ebe4728ea5faca3d5ed173726c0578e4ea: Status 404 returned error can't find the container with id ac51c538b9fc76c7e7392a1e4bfab5ebe4728ea5faca3d5ed173726c0578e4ea Jun 11 00:42:54.852786 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.852690 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xblr4_8626ce16-c5fb-4255-93bd-062aa41817c2/dns/0.log" Jun 11 00:42:54.870391 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.870352 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xblr4_8626ce16-c5fb-4255-93bd-062aa41817c2/kube-rbac-proxy/0.log" Jun 11 00:42:54.890104 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:54.890078 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5xr57_5028d8be-d56a-4c7a-a01e-17f5579913e4/dns-node-resolver/0.log" Jun 11 00:42:55.200416 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.200324 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" event={"ID":"db563aaa-ff41-47a2-a30c-f3e7db20f679","Type":"ContainerStarted","Data":"6e7f4ce7625b05b2c7591e13dcccb3c66f948ab0e6c419b6ac644a085482d118"} Jun 11 00:42:55.200808 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.200445 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:42:55.200808 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.200474 2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" event={"ID":"db563aaa-ff41-47a2-a30c-f3e7db20f679","Type":"ContainerStarted","Data":"ac51c538b9fc76c7e7392a1e4bfab5ebe4728ea5faca3d5ed173726c0578e4ea"} Jun 11 00:42:55.215547 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.215502 2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" podStartSLOduration=1.21548818 podStartE2EDuration="1.21548818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 00:42:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 00:42:55.21418941 +0000 UTC m=+2506.248565963" watchObservedRunningTime="2026-06-11 00:42:55.21548818 +0000 UTC m=+2506.249864734" Jun 11 00:42:55.470248 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.470173 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7956f4f5c6-gx2p5_6b018f5c-4541-470a-9441-86e229fe0a75/registry/0.log" Jun 11 00:42:55.478778 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.478753 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7956f4f5c6-gx2p5_6b018f5c-4541-470a-9441-86e229fe0a75/registry/1.log" Jun 11 00:42:55.538777 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:55.538758 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-w69dp_c8df0dcc-e346-46ed-ac90-89794ce063c4/node-ca/0.log" Jun 11 00:42:56.530074 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:56.530039 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db9bd6bdc-nbdnr_c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa/kube-auth-proxy/0.log" Jun 11 00:42:56.615064 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:56.615038 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7pmsj_2b61c15a-f271-471f-ae9b-ea0e30850103/payload-pre-processing/0.log" Jun 11 00:42:56.674162 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:56.674134 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2c4ph_a00c5e59-da83-47d4-80dc-2c37e8a77788/payload-processing/0.log" Jun 11 00:42:56.692687 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:56.692658 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log" Jun 11 00:42:57.292313 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:57.292279 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-l6h42_fcd43112-182d-4122-a6c3-73cab83ce955/serve-healthcheck-canary/0.log" Jun 11 00:42:57.890294 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:57.890256 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vq5zh_daf6caa9-58ed-4004-9322-5db2c868b6fa/kube-rbac-proxy/0.log" Jun 11 00:42:57.908280 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:57.908258 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vq5zh_daf6caa9-58ed-4004-9322-5db2c868b6fa/exporter/0.log" Jun 11 00:42:57.926490 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:42:57.926462 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-vq5zh_daf6caa9-58ed-4004-9322-5db2c868b6fa/extractor/0.log" Jun 11 00:43:00.275744 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.275715 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-rqz4h_d8530f70-8bec-4637-ad40-2b86dbf7eaeb/manager/0.log" Jun 11 00:43:00.328218 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.328188 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29685615-5xz9z_7605ca60-bd46-40c8-9d32-e59e3189f93f/cleanup/0.log" Jun 11 00:43:00.416348 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.416324 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5b8467c765-cqj8b_f191bcd0-341d-4043-876e-70141d766d32/manager/0.log" Jun 11 00:43:00.435139 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.435117 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-h4s6t_9f1c6f9f-985c-417d-b555-ad3545933c0d/server/0.log" Jun 11 00:43:00.660598 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.660517 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-948c7c79b-rldjm_c5e3e1c9-9faa-4abe-b161-8478125932dd/manager/0.log" Jun 11 00:43:00.677907 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:00.677866 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-948c7c79b-rldjm_c5e3e1c9-9faa-4abe-b161-8478125932dd/copy-manifests/0.log" Jun 11 00:43:01.215021 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:01.214993 2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j9fw5/perf-node-gather-daemonset-66rcz" Jun 11 00:43:02.202795 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:02.202768 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f9dd6846b-28qmd_c438a717-8e9e-41ad-bbf2-eadab14b607b/manager/0.log" Jun 11 00:43:07.886874 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:07.886842 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fl989_5a680d33-a66f-439b-82ea-15083c272cc4/kube-storage-version-migrator-operator/1.log" Jun 11 00:43:07.887645 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:07.887630 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-fl989_5a680d33-a66f-439b-82ea-15083c272cc4/kube-storage-version-migrator-operator/0.log" Jun 11 00:43:07.976999 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:07.976973 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db9bd6bdc-nbdnr_c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa/kube-auth-proxy/0.log" Jun 11 00:43:08.048659 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:08.048638 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7pmsj_2b61c15a-f271-471f-ae9b-ea0e30850103/payload-pre-processing/0.log" Jun 11 00:43:08.095595 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:08.095570 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2c4ph_a00c5e59-da83-47d4-80dc-2c37e8a77788/payload-processing/0.log" Jun 11 00:43:08.109732 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:08.109711 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log" Jun 11 00:43:09.192526 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.192496 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9hclj_c60908e2-edf4-4e65-88c5-99895dae5946/kube-multus/0.log" Jun 11 00:43:09.279630 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.279600 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db9bd6bdc-nbdnr_c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa/kube-auth-proxy/0.log" Jun 11 00:43:09.352771 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.352739 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7pmsj_2b61c15a-f271-471f-ae9b-ea0e30850103/payload-pre-processing/0.log" Jun 11 00:43:09.361331 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.361309 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/kube-multus-additional-cni-plugins/0.log" Jun 11 00:43:09.380533 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.380510 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/egress-router-binary-copy/0.log" Jun 11 00:43:09.401081 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.401064 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/cni-plugins/0.log" Jun 11 00:43:09.403836 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.403818 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2c4ph_a00c5e59-da83-47d4-80dc-2c37e8a77788/payload-processing/0.log" Jun 11 00:43:09.416070 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.416050 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log" Jun 11 00:43:09.420022 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.419996 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/bond-cni-plugin/0.log" Jun 11 00:43:09.445557 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.445499 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/routeoverride-cni/0.log" Jun 11 00:43:09.468841 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.468821 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/whereabouts-cni-bincopy/0.log" Jun 11 00:43:09.493623 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.493606 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mzqrh_03afd107-494a-41a2-bfcb-cab57d031808/whereabouts-cni/0.log" Jun 11 00:43:09.701856 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.701778 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28x5s_a96e0628-ae65-4495-a644-1d920aae686d/network-metrics-daemon/0.log" Jun 11 00:43:09.718826 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:09.718802 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-28x5s_a96e0628-ae65-4495-a644-1d920aae686d/kube-rbac-proxy/0.log" Jun 11 00:43:10.925547 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.925522 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-controller/0.log" Jun 11 00:43:10.940992 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.940972 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/1.log" Jun 11 00:43:10.941121 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.941030 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovn-acl-logging/0.log" Jun 11 00:43:10.958699 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.958681 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/kube-rbac-proxy-node/0.log" Jun 11 00:43:10.977515 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.977489 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 00:43:10.991988 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:10.991970 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/northd/0.log" Jun 11 00:43:11.015783 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.015765 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/nbdb/0.log" Jun 11 00:43:11.039544 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.039525 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/sbdb/0.log" Jun 11 00:43:11.086865 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.086848 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rw7tr_1fd2f49f-a4e3-4b9d-8d63-2116d20227cb/ovnkube-controller/0.log" Jun 11 00:43:11.107067 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.107054 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-db9bd6bdc-nbdnr_c0e1f6b2-9103-4431-ada7-0c88d3a8b1fa/kube-auth-proxy/0.log" Jun 11 00:43:11.174022 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.173996 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-7pmsj_2b61c15a-f271-471f-ae9b-ea0e30850103/payload-pre-processing/0.log" Jun 11 00:43:11.223052 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.222988 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-2c4ph_a00c5e59-da83-47d4-80dc-2c37e8a77788/payload-processing/0.log" Jun 11 00:43:11.237018 ip-10-0-138-70 kubenswrapper[2558]: I0611 00:43:11.236998 2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f698f98d7-6trdv_1b4dbda6-d4f7-43b7-99d6-de9677adb2b3/router/0.log"