Jun 08 21:54:52.193042 ip-10-0-140-66 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 21:54:52.193053 ip-10-0-140-66 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 21:54:52.193060 ip-10-0-140-66 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 21:54:52.193318 ip-10-0-140-66 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 21:55:02.227220 ip-10-0-140-66 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 21:55:02.227243 ip-10-0-140-66 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1152bf82e266426ca3633336e77aae9d -- Jun 08 21:57:39.747171 ip-10-0-140-66 systemd[1]: Starting Kubernetes Kubelet... Jun 08 21:57:40.200218 ip-10-0-140-66 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:40.200218 ip-10-0-140-66 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 21:57:40.200218 ip-10-0-140-66 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:40.200218 ip-10-0-140-66 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 21:57:40.200218 ip-10-0-140-66 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 21:57:40.201442 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.201264 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 21:57:40.208018 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.207997 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.208018 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208016 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.208018 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208022 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.208018 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208027 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208031 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208036 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208040 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208046 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208050 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208055 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208060 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208064 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208069 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208072 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208076 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208079 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208086 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208091 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208096 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208101 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208105 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208110 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.208255 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208113 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208117 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208121 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208126 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208137 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208141 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208146 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208150 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208155 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208159 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208164 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208168 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208172 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208176 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208181 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208188 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208192 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208197 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208201 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208207 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.209106 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208214 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208218 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208224 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208228 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208232 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208236 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208241 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208245 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208249 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208253 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208257 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208260 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208265 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208269 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208273 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208277 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208281 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208286 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208290 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208294 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.210067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208299 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208303 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208308 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208313 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208317 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208321 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208326 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208331 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208335 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208339 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208344 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208348 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208354 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208359 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208363 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208368 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208372 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208377 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208381 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208385 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.210901 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208389 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208393 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208398 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208403 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208407 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208411 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208416 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208420 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208424 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208428 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208436 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208440 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208445 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208449 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208454 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208458 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.208462 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209719 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209730 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209736 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.211757 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209741 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209745 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209750 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209755 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209759 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209764 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209769 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209774 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209778 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209783 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209788 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209793 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209797 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209801 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209805 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209809 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209814 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209817 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209821 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209824 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.212613 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209828 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209831 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209837 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209843 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209847 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209851 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209855 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209859 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209882 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209887 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209891 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209895 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209898 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209902 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209906 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209910 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209914 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209918 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209922 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209927 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.213361 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209931 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209935 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209939 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209943 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209948 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209952 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209959 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209964 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209969 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209974 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209978 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209983 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209987 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209991 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.209996 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210000 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210006 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210011 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210015 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210019 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.213962 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210023 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210028 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210033 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210038 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210042 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210048 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210052 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210057 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210061 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210065 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210068 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210072 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210076 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210080 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210084 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210088 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210092 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210096 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210100 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.214579 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210105 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210109 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210114 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210121 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210125 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210129 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210135 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210139 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210144 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210148 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210157 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210163 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210168 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210172 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210177 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210181 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210185 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210895 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210905 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210910 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.215067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210914 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210919 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210923 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210930 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210936 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210940 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210945 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210950 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210955 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210959 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210964 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210968 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210973 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210978 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210982 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210987 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210992 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.210996 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211001 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.215615 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211005 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211010 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211014 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211020 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211025 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211029 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211034 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211038 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211042 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211047 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211051 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211055 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211061 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211065 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211069 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211074 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211078 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211082 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211087 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211091 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.216143 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211095 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211099 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211103 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211107 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211112 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211116 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211121 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211125 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211130 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211134 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211138 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211143 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211147 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211152 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211157 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211161 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211166 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211170 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211174 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211178 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.216645 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211183 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211187 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211190 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211195 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211199 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211203 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211207 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211211 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211216 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211220 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211225 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211230 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211234 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211238 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211245 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211250 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211255 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211259 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211263 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.217197 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211267 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211271 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211276 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211280 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211284 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211289 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211293 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211298 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211302 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211306 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211313 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211318 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211322 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211327 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211331 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211335 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211339 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.211343 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211435 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211446 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 21:57:40.217658 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211456 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211462 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211469 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211474 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211480 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211487 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211492 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211496 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211502 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211508 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211512 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211517 2562 flags.go:64] FLAG: --cgroup-root="" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211522 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211528 2562 flags.go:64] FLAG: --client-ca-file="" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211532 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211537 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211544 2562 flags.go:64] FLAG: --cluster-domain="" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211549 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211554 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211559 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211564 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211571 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211575 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 21:57:40.218192 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211581 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211586 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211591 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211595 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211600 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211605 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211610 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211616 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211621 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211625 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211630 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211634 2562 flags.go:64] FLAG: --enable-server="true" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211639 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211646 2562 flags.go:64] FLAG: --event-burst="100" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211651 2562 flags.go:64] FLAG: --event-qps="50" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211656 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211660 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211668 2562 flags.go:64] FLAG: --eviction-hard="" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211674 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211679 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211684 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211689 2562 flags.go:64] FLAG: --eviction-soft="" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211693 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211698 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211703 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 21:57:40.218801 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211707 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211712 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211716 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211721 2562 flags.go:64] FLAG: --feature-gates="" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211728 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211732 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211737 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211742 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211748 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211752 2562 flags.go:64] FLAG: --help="false" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211756 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211761 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211765 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211770 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211775 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211780 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211784 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211788 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211796 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211802 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211806 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211811 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211816 2562 flags.go:64] FLAG: --kube-reserved="" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211821 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 21:57:40.219455 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211826 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211831 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211836 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211841 2562 flags.go:64] FLAG: --lock-file="" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211845 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211850 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211855 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211882 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211887 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211891 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211896 2562 flags.go:64] FLAG: --logging-format="text" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211901 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211906 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211911 2562 flags.go:64] FLAG: --manifest-url="" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211915 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211922 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211926 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211934 2562 flags.go:64] FLAG: --max-pods="110" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211939 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211944 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211948 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211953 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211958 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211962 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211967 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 21:57:40.220057 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211978 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211985 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211990 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211994 2562 flags.go:64] FLAG: --pod-cidr="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.211999 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212007 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212011 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212016 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212022 2562 flags.go:64] FLAG: --port="10250" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212027 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212032 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0742118cee8f9d917" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212037 2562 flags.go:64] FLAG: --qos-reserved="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212042 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212047 2562 flags.go:64] FLAG: --register-node="true" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212052 2562 flags.go:64] FLAG: --register-with-taints="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212057 2562 flags.go:64] FLAG: --registry-burst="10" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212062 2562 flags.go:64] FLAG: --registry-qps="5" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212067 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212072 2562 flags.go:64] FLAG: --reserved-memory="" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212078 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212083 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212087 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212092 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212097 2562 flags.go:64] FLAG: --runonce="false" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212101 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 21:57:40.220683 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212107 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212112 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212116 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212121 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212126 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212130 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212135 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212139 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212146 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212150 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212155 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212160 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212165 2562 flags.go:64] FLAG: --system-cgroups="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212169 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212178 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212184 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212189 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212196 2562 flags.go:64] FLAG: --tls-min-version="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212201 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212205 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212210 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212215 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212219 2562 flags.go:64] FLAG: --v="2" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212226 2562 flags.go:64] FLAG: --version="false" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212232 2562 flags.go:64] FLAG: --vmodule="" Jun 08 21:57:40.221315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212238 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212243 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212425 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212432 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212438 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212442 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212449 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212455 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212461 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212466 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212471 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212475 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212479 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212484 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212488 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212496 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212502 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212507 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212512 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.221970 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212516 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212521 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212526 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212532 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212536 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212541 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212546 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212551 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212555 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212560 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212565 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212569 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212573 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212578 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212583 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212587 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212592 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212596 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212600 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212605 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.222426 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212609 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212612 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212617 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212621 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212625 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212629 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212633 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212637 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212643 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212647 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212651 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212656 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212660 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212664 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212668 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212674 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212678 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212682 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212686 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212691 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.222927 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212695 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212699 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212704 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212708 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212712 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212716 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212720 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212725 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212729 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212734 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212738 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212742 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212746 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212750 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212755 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212760 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212764 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212768 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212773 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212777 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.223707 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212782 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212786 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212790 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212795 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212799 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212803 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212807 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212813 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212817 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212822 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212826 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212830 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212834 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212840 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212845 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212850 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212854 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212859 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212884 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.224405 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212889 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212893 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.212897 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.212906 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.220520 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.220540 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.220559 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.220571 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220628 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220632 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220636 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220638 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220641 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220644 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.224893 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220647 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220651 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220655 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220658 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220660 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220663 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220665 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220668 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220670 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220673 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220675 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220678 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220680 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220683 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220686 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220688 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220691 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220694 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220697 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.225256 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220699 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220702 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220705 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220707 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220716 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220719 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220721 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220724 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220726 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220729 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220731 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220734 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220736 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220738 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220742 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220745 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220748 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220751 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220754 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220756 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.225723 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220759 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220762 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220764 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220767 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220769 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220772 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220774 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220777 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220780 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220782 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220785 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220788 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220791 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220794 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220796 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220799 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220802 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220811 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220813 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220816 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.226228 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220819 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220821 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220824 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220826 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220829 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220831 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220834 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220836 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220839 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220841 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220844 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220846 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220849 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220851 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220854 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220856 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220859 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220879 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220882 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220884 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.226738 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220887 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220890 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220893 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220897 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220901 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220903 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220906 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220908 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220912 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220914 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220923 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220926 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220929 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.220931 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.220936 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:40.227230 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221085 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221089 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221092 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221095 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221098 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221101 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221103 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221106 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221108 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221111 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221114 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221116 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221119 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221121 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221125 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221129 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221132 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221135 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221137 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 21:57:40.227604 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221140 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221143 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221147 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221149 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221152 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221154 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221157 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221160 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221162 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221170 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221173 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221175 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221178 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221181 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221183 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221186 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221197 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221200 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221202 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221205 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 21:57:40.228067 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221207 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221210 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221212 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221216 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221218 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221220 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221223 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221225 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221228 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221230 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221233 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221235 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221238 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221240 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221243 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221245 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221248 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221251 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221253 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221256 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 21:57:40.228548 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221259 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221261 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221271 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221273 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221276 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221278 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221281 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221283 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221285 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221296 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221299 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221301 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221304 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221307 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221309 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221312 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221314 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221316 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221319 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 21:57:40.229113 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221322 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221324 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221327 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221330 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221332 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221335 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221338 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221340 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221343 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221345 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221348 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221351 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221353 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221357 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221360 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221363 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221374 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221376 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221379 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221382 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 21:57:40.229582 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:40.221384 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.221390 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.221518 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.225459 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.227114 2562 server.go:1019] "Starting client certificate rotation" Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.227211 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.227242 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 21:57:40.230077 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.229855 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:57:40.231829 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.231814 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 21:57:40.243298 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.243280 2562 log.go:25] "Validated CRI v1 runtime API" Jun 08 21:57:40.248150 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.248136 2562 log.go:25] "Validated CRI v1 image API" Jun 08 21:57:40.248933 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.248916 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 21:57:40.251488 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.251470 2562 fs.go:135] Filesystem UUIDs: map[2c58716d-fdf5-4626-af73-bc7b42d51e15:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7aba4deb-ca47-4b90-9f6c-6b20c6c8dc5e:/dev/nvme0n1p4] Jun 08 21:57:40.251585 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.251487 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 21:57:40.257993 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.257881 2562 manager.go:216] Machine: {Timestamp:2026-06-08 21:57:40.256407558 +0000 UTC m=+0.379457359 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102382 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d449bab722b3dabd96f1d07ca2883 SystemUUID:ec2d449b-ab72-2b3d-abd9-6f1d07ca2883 BootID:1152bf82-e266-426c-a363-3336e77aae9d Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c5:d4:17:c0:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c5:d4:17:c0:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:2b:24:e7:81:80 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 21:57:40.257993 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.257987 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 21:57:40.258113 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.258063 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 21:57:40.261486 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.261463 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 21:57:40.261612 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.261490 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-66.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 21:57:40.262294 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.262285 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 21:57:40.262332 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.262297 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 21:57:40.262332 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.262305 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:57:40.262332 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.262319 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 21:57:40.263475 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.263456 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:57:40.263634 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.263623 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 21:57:40.268004 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.267992 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:57:40.268110 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268101 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 21:57:40.268140 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268135 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 08 21:57:40.268168 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268146 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 21:57:40.268168 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268157 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 21:57:40.268168 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268165 2562 kubelet.go:398] "Adding apiserver pod source" Jun 08 21:57:40.268249 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268173 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 21:57:40.268591 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268575 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:57:40.268665 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.268595 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 21:57:40.275190 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.275165 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 21:57:40.278174 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.278158 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 21:57:40.278251 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.278189 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 21:57:40.279685 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.279662 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 21:57:40.279726 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.279662 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-66.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 21:57:40.279857 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279847 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279879 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279886 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279891 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279900 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279905 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 21:57:40.279912 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279913 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 21:57:40.280068 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279918 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 21:57:40.280068 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279924 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 21:57:40.280068 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279930 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 21:57:40.280068 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279938 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 21:57:40.280068 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.279943 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 21:57:40.280890 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.280881 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 21:57:40.280922 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.280891 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 21:57:40.283362 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.283346 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z4q8l" Jun 08 21:57:40.283945 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.283933 2562 server.go:1268] "Started kubelet" Jun 08 21:57:40.284055 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.284026 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 21:57:40.284122 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.284051 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 21:57:40.284165 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.284123 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 21:57:40.285039 ip-10-0-140-66 systemd[1]: Started Kubernetes Kubelet. Jun 08 21:57:40.286171 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.286149 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 08 21:57:40.286276 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.286258 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 21:57:40.288905 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.288888 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-66.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 21:57:40.289994 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.288857 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-66.ec2.internal.18b739eb44df5e2f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-66.ec2.internal,UID:ip-10-0-140-66.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-66.ec2.internal,},FirstTimestamp:2026-06-08 21:57:40.283907631 +0000 UTC m=+0.406957432,LastTimestamp:2026-06-08 21:57:40.283907631 +0000 UTC m=+0.406957432,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-66.ec2.internal,}" Jun 08 21:57:40.290980 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.290952 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 21:57:40.292966 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.292949 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-z4q8l" Jun 08 21:57:40.293771 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.293758 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 21:57:40.293826 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.293777 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 21:57:40.293901 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.293822 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.294815 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294798 2562 factory.go:153] Registering CRI-O factory Jun 08 21:57:40.294815 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294815 2562 factory.go:223] Registration of the crio container factory successfully Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294889 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294897 2562 factory.go:55] Registering systemd factory Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294903 2562 factory.go:223] Registration of the systemd container factory successfully Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294920 2562 factory.go:103] Registering Raw factory Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294934 2562 manager.go:1196] Started watching for new ooms in manager Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294961 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294964 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 21:57:40.294988 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.294982 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 21:57:40.295307 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.295098 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 08 21:57:40.295307 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.295106 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 08 21:57:40.295461 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.295447 2562 manager.go:349] Starting recovery of all containers Jun 08 21:57:40.299346 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.299193 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:40.303042 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.303021 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-66.ec2.internal\" not found" node="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.305300 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.305282 2562 manager.go:354] Recovery completed Jun 08 21:57:40.311026 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.311014 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.313246 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313198 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.313246 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313230 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.313246 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313243 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.313738 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313725 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 21:57:40.313738 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313738 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 21:57:40.313828 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313753 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 08 21:57:40.313828 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.313797 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.314467 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.314449 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.314544 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.314479 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.314544 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.314490 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.315802 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.315787 2562 policy_none.go:49] "None policy: Start" Jun 08 21:57:40.315882 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.315805 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 21:57:40.315882 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.315816 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 21:57:40.317609 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.317598 2562 policy_none.go:47] "Start" Jun 08 21:57:40.356444 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356429 2562 manager.go:337] "Starting Device Plugin manager" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.356459 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356471 2562 server.go:87] "Starting device plugin registration server" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356721 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356735 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356795 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356891 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.356900 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.357488 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.357540 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.369566 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.370783 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.370815 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.370834 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.370921 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 21:57:40.378044 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.373408 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:40.457030 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.456941 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.457986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.457969 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.458049 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.458004 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.458049 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.458016 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.458049 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.458038 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.466251 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.466236 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.466295 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.466258 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-66.ec2.internal\": node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.471557 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.471540 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal"] Jun 08 21:57:40.471623 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.471595 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.472338 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.472323 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.472407 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.472353 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.472407 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.472365 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.474850 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.474838 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.474970 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.474957 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.475004 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.474985 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.475507 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475491 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.475572 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475520 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.475572 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475529 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.475629 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475493 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.475629 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475589 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.475629 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.475598 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.477769 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.477754 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.477823 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.477778 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 21:57:40.478498 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.478481 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientMemory" Jun 08 21:57:40.478574 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.478510 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 21:57:40.478574 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.478523 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeHasSufficientPID" Jun 08 21:57:40.482041 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.482026 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.496450 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.496431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.496508 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.496454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.496508 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.496469 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56554d0b4ec320ab1a2afe7ff9f853be-config\") pod \"kube-apiserver-proxy-ip-10-0-140-66.ec2.internal\" (UID: \"56554d0b4ec320ab1a2afe7ff9f853be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.502628 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.502602 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-66.ec2.internal\" not found" node="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.506933 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.506917 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-66.ec2.internal\" not found" node="ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.582220 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.582193 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.597038 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.597102 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.597102 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56554d0b4ec320ab1a2afe7ff9f853be-config\") pod \"kube-apiserver-proxy-ip-10-0-140-66.ec2.internal\" (UID: \"56554d0b4ec320ab1a2afe7ff9f853be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.597163 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56554d0b4ec320ab1a2afe7ff9f853be-config\") pod \"kube-apiserver-proxy-ip-10-0-140-66.ec2.internal\" (UID: \"56554d0b4ec320ab1a2afe7ff9f853be\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.597163 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597134 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.597232 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.597120 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e373c95bf2111aa8746e7ecc77167f5c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal\" (UID: \"e373c95bf2111aa8746e7ecc77167f5c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.683086 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.683063 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.783897 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.783823 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.809341 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.809319 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.814122 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:40.813951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:40.884333 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.884306 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:40.984860 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:40.984838 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:41.085458 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.085378 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:41.173488 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.173352 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:41.185919 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.185899 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-66.ec2.internal\" not found" Jun 08 21:57:41.226476 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.226452 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 21:57:41.227084 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.226599 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:57:41.227084 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.226599 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:57:41.227084 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.226623 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 21:57:41.245147 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.245129 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:41.268575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.268551 2562 apiserver.go:52] "Watching apiserver" Jun 08 21:57:41.277111 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.277093 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 21:57:41.278185 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.278166 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-7fvwx","openshift-network-diagnostics/network-check-target-tcxh4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl","openshift-cluster-node-tuning-operator/tuned-mzwn9","openshift-dns/node-resolver-7flpz","openshift-multus/multus-66spw","openshift-network-operator/iptables-alerter-vvx7d","openshift-ovn-kubernetes/ovnkube-node-7sxpr","kube-system/global-pull-secret-syncer-2sljn","kube-system/konnectivity-agent-2zbzb","openshift-image-registry/node-ca-k2wvd","openshift-multus/multus-additional-cni-plugins-dp75n"] Jun 08 21:57:41.280725 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.280706 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.280807 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.280791 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:41.282764 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.282749 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:41.282822 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.282807 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:41.286198 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.285562 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.287917 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.287842 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 21:57:41.287917 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.287884 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.288072 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.287944 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4mdr8\"" Jun 08 21:57:41.288072 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.287995 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.289007 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.288990 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.291281 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.291264 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.291479 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.291403 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.291479 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.291437 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sxgdf\"" Jun 08 21:57:41.291644 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.291630 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.293003 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.292985 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.293063 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.293008 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-blkv5\"" Jun 08 21:57:41.293283 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.293270 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.293415 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.293397 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66spw" Jun 08 21:57:41.294339 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.294306 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 21:57:41.294339 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.294333 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" Jun 08 21:57:41.295209 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295186 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 21:57:41.295209 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295200 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 21:57:41.295380 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295234 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.295380 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.295380 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-94lzk\"" Jun 08 21:57:41.295522 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.295693 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295652 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 21:52:40 +0000 UTC" deadline="2028-01-17 11:50:23.732681956 +0000 UTC" Jun 08 21:57:41.295759 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.295695 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14101h52m42.436990373s" Jun 08 21:57:41.297161 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.297145 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.297252 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.297229 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 21:57:41.297418 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.297405 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.297461 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.297434 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m9mbf\"" Jun 08 21:57:41.297965 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.297948 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.299743 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.299728 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 21:57:41.299928 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.299858 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 21:57:41.300009 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.299991 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.300384 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300366 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.300451 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-modprobe-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300451 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.300438 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:41.300554 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300457 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-kubernetes\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300554 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74fjj\" (UniqueName: \"kubernetes.io/projected/03411705-2d29-4134-9ede-ade8a24b8d87-kube-api-access-74fjj\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.300554 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-system-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300554 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300542 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-bin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300565 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-kubelet\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300594 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-conf-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300617 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-daemon-config\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-run\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300673 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-var-lib-kubelet\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-host\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300726 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-tuned\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300749 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-multus-certs\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.300788 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300787 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300789 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9tt\" (UniqueName: \"kubernetes.io/projected/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-kube-api-access-db9tt\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvc2l\" (UniqueName: \"kubernetes.io/projected/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kube-api-access-tvc2l\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300827 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301221 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1248aa9-d0c7-41f9-b502-1013aef626d6-iptables-alerter-script\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301249 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.300907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7xjhk\"" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-netns\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.301356 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-registration-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301366 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-device-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1248aa9-d0c7-41f9-b502-1013aef626d6-host-slash\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301428 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bnzj\" (UniqueName: \"kubernetes.io/projected/a1248aa9-d0c7-41f9-b502-1013aef626d6-kube-api-access-6bnzj\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301461 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-etc-kubernetes\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-etc-selinux\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301574 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysconfig\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-sys\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-lib-modules\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301639 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03411705-2d29-4134-9ede-ade8a24b8d87-tmp-dir\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.301709 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301702 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cnibin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cni-binary-copy\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-socket-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-conf\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-systemd\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301830 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7h7m\" (UniqueName: \"kubernetes.io/projected/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-kube-api-access-w7h7m\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301851 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-multus\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-sys-fs\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-tmp\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03411705-2d29-4134-9ede-ade8a24b8d87-hosts-file\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.301993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-os-release\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.302031 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-socket-dir-parent\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.302053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-k8s-cni-cncf-io\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.302076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-hostroot\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.302239 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.302097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwqhh\" (UniqueName: \"kubernetes.io/projected/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-kube-api-access-kwqhh\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.302881 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.302845 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.304442 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.304422 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 21:57:41.304641 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.304624 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fhcqt\"" Jun 08 21:57:41.304735 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.304687 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 21:57:41.304938 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.304921 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:57:41.305002 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.304988 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" Jun 08 21:57:41.305227 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.305209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.307780 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.307764 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal"] Jun 08 21:57:41.307876 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.307847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.310348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310304 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 21:57:41.310348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 21:57:41.310348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310326 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vwnpk\"" Jun 08 21:57:41.310533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310371 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-k8qjb\"" Jun 08 21:57:41.310533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310380 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 21:57:41.310533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 21:57:41.310636 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.310567 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 21:57:41.312024 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.312008 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 21:57:41.316706 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.316691 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 21:57:41.316780 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.316768 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal"] Jun 08 21:57:41.327684 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.327645 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode373c95bf2111aa8746e7ecc77167f5c.slice/crio-349310784ba3f8376cc3716a439c8a93d4a523a51da1ad0bd6918e92dbdb3baa WatchSource:0}: Error finding container 349310784ba3f8376cc3716a439c8a93d4a523a51da1ad0bd6918e92dbdb3baa: Status 404 returned error can't find the container with id 349310784ba3f8376cc3716a439c8a93d4a523a51da1ad0bd6918e92dbdb3baa Jun 08 21:57:41.328007 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.327987 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56554d0b4ec320ab1a2afe7ff9f853be.slice/crio-dc9b0f0f5a9ab7d703426c1674e7211cc1c178f693ee7fef1590a12ad0e275a2 WatchSource:0}: Error finding container dc9b0f0f5a9ab7d703426c1674e7211cc1c178f693ee7fef1590a12ad0e275a2: Status 404 returned error can't find the container with id dc9b0f0f5a9ab7d703426c1674e7211cc1c178f693ee7fef1590a12ad0e275a2 Jun 08 21:57:41.335139 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.334002 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcgv9" Jun 08 21:57:41.336093 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.336077 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 21:57:41.342987 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.342972 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dcgv9" Jun 08 21:57:41.375024 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.374990 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" event={"ID":"e373c95bf2111aa8746e7ecc77167f5c","Type":"ContainerStarted","Data":"349310784ba3f8376cc3716a439c8a93d4a523a51da1ad0bd6918e92dbdb3baa"} Jun 08 21:57:41.376104 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.376083 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" event={"ID":"56554d0b4ec320ab1a2afe7ff9f853be","Type":"ContainerStarted","Data":"dc9b0f0f5a9ab7d703426c1674e7211cc1c178f693ee7fef1590a12ad0e275a2"} Jun 08 21:57:41.396195 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.396177 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 21:57:41.402921 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.402906 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-run\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.402971 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.402929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-var-lib-kubelet\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.402971 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.402945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-tuned\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403063 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.402973 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmd9s\" (UniqueName: \"kubernetes.io/projected/354705d3-adde-4fdb-b29f-59477933fca3-kube-api-access-bmd9s\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.403063 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-run\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403063 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403022 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-var-lib-kubelet\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403063 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403101 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1248aa9-d0c7-41f9-b502-1013aef626d6-iptables-alerter-script\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403150 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403170 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403188 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-systemd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.403240 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403218 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1248aa9-d0c7-41f9-b502-1013aef626d6-host-slash\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-etc-kubernetes\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-etc-kubernetes\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403276 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1248aa9-d0c7-41f9-b502-1013aef626d6-host-slash\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403288 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403304 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-etc-selinux\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403320 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c86124b9-2208-42b3-8365-9c0b4bd09e26-agent-certs\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403335 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-sys\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-lib-modules\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-etc-selinux\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-netns\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403406 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47hqw\" (UniqueName: \"kubernetes.io/projected/802c71df-0443-447c-b19a-1adfb72e7314-kube-api-access-47hqw\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403408 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-sys\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403436 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03411705-2d29-4134-9ede-ade8a24b8d87-tmp-dir\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403470 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cnibin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.403575 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403491 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kubelet-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403492 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-lib-modules\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403495 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cni-binary-copy\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1248aa9-d0c7-41f9-b502-1013aef626d6-iptables-alerter-script\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403626 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-socket-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cnibin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403699 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-conf\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03411705-2d29-4134-9ede-ade8a24b8d87-tmp-dir\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7h7m\" (UniqueName: \"kubernetes.io/projected/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-kube-api-access-w7h7m\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-socket-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403799 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-kubelet-config\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysctl-conf\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-slash\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-var-lib-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403928 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-socket-dir-parent\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-hostroot\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.404344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-device-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-ovn\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403993 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-socket-dir-parent\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404004 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-netd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.403995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-hostroot\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-system-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-device-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-cni-binary-copy\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-kubelet\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-system-cni-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404077 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-kubelet\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-multus-certs\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9tt\" (UniqueName: \"kubernetes.io/projected/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-kube-api-access-db9tt\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-multus-certs\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvc2l\" (UniqueName: \"kubernetes.io/projected/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kube-api-access-tvc2l\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404146 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/354705d3-adde-4fdb-b29f-59477933fca3-serviceca\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6b7f\" (UniqueName: \"kubernetes.io/projected/1b20c166-9167-4e40-894d-938100e4e557-kube-api-access-s6b7f\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.405194 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404179 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-host\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-env-overrides\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-host\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/802c71df-0443-447c-b19a-1adfb72e7314-ovn-node-metrics-cert\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-netns\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-registration-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404339 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-system-cni-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404367 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bnzj\" (UniqueName: \"kubernetes.io/projected/a1248aa9-d0c7-41f9-b502-1013aef626d6-kube-api-access-6bnzj\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404374 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-netns\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404384 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-registration-dir\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404431 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/354705d3-adde-4fdb-b29f-59477933fca3-host\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.404460 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404458 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.404541 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:41.904505282 +0000 UTC m=+2.027555085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:41.405846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysconfig\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-config\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404702 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-sysconfig\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-script-lib\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-dbus\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c86124b9-2208-42b3-8365-9c0b4bd09e26-konnectivity-ca\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404794 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404825 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-log-socket\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-bin\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-systemd\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404943 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-multus\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-sys-fs\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404982 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-systemd\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.404993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-cnibin\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-multus\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-etc-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406348 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-sys-fs\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-tmp\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03411705-2d29-4134-9ede-ade8a24b8d87-hosts-file\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/03411705-2d29-4134-9ede-ade8a24b8d87-hosts-file\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-os-release\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-k8s-cni-cncf-io\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwqhh\" (UniqueName: \"kubernetes.io/projected/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-kube-api-access-kwqhh\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405211 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-systemd-units\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405219 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-os-release\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-run-k8s-cni-cncf-io\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405233 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-node-log\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-modprobe-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-kubernetes\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405314 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74fjj\" (UniqueName: \"kubernetes.io/projected/03411705-2d29-4134-9ede-ade8a24b8d87-kube-api-access-74fjj\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-bin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-conf-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-modprobe-d\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.406913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-daemon-config\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-kubernetes\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405420 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-conf-dir\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405463 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-os-release\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405488 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-kubelet\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.405594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-host-var-lib-cni-bin\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.406027 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-multus-daemon-config\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.406568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-etc-tuned\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.407487 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.407104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-tmp\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.409795 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.409778 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:41.409901 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.409801 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:41.409901 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.409814 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:41.409988 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.409900 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:41.909882582 +0000 UTC m=+2.032932384 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:41.412767 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.412734 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9tt\" (UniqueName: \"kubernetes.io/projected/b8e71d9a-7855-47a5-9cd7-a5ec09616e8e-kube-api-access-db9tt\") pod \"multus-66spw\" (UID: \"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e\") " pod="openshift-multus/multus-66spw" Jun 08 21:57:41.415717 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.415691 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bnzj\" (UniqueName: \"kubernetes.io/projected/a1248aa9-d0c7-41f9-b502-1013aef626d6-kube-api-access-6bnzj\") pod \"iptables-alerter-vvx7d\" (UID: \"a1248aa9-d0c7-41f9-b502-1013aef626d6\") " pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.415806 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.415781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvc2l\" (UniqueName: \"kubernetes.io/projected/2926dcff-ef0e-497a-a7e7-0ddd59b14d94-kube-api-access-tvc2l\") pod \"aws-ebs-csi-driver-node-twhkl\" (UID: \"2926dcff-ef0e-497a-a7e7-0ddd59b14d94\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.416220 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.416201 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7h7m\" (UniqueName: \"kubernetes.io/projected/b33c8c0e-907f-4a28-8e5f-f7471b1ef45f-kube-api-access-w7h7m\") pod \"tuned-mzwn9\" (UID: \"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f\") " pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.419008 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.418986 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-74fjj\" (UniqueName: \"kubernetes.io/projected/03411705-2d29-4134-9ede-ade8a24b8d87-kube-api-access-74fjj\") pod \"node-resolver-7flpz\" (UID: \"03411705-2d29-4134-9ede-ade8a24b8d87\") " pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.420064 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.420048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwqhh\" (UniqueName: \"kubernetes.io/projected/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-kube-api-access-kwqhh\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.506770 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.506770 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-env-overrides\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/802c71df-0443-447c-b19a-1adfb72e7314-ovn-node-metrics-cert\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-system-cni-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/354705d3-adde-4fdb-b29f-59477933fca3-host\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506853 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506891 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-config\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-script-lib\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-system-cni-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-dbus\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506916 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/354705d3-adde-4fdb-b29f-59477933fca3-host\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506946 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c86124b9-2208-42b3-8365-9c0b4bd09e26-konnectivity-ca\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.506986 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.506992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-dbus\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507015 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-log-socket\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-bin\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507085 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-cnibin\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507111 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-etc-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.507119 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507140 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-systemd-units\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.507169 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:57:42.007152268 +0000 UTC m=+2.130202059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-node-log\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507217 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-bin\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507061 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-log-socket\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507237 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507263 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-cnibin\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507272 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-os-release\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507307 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-etc-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507333 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-kubelet\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.507604 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507338 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-os-release\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507363 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmd9s\" (UniqueName: \"kubernetes.io/projected/354705d3-adde-4fdb-b29f-59477933fca3-kube-api-access-bmd9s\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507380 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-node-log\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507388 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507416 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507427 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-env-overrides\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507439 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-config\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-systemd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c86124b9-2208-42b3-8365-9c0b4bd09e26-agent-certs\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/802c71df-0443-447c-b19a-1adfb72e7314-ovnkube-script-lib\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507490 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-kubelet\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-netns\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47hqw\" (UniqueName: \"kubernetes.io/projected/802c71df-0443-447c-b19a-1adfb72e7314-kube-api-access-47hqw\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507612 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-systemd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508349 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-kubelet-config\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507656 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-slash\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-var-lib-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-slash\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1b20c166-9167-4e40-894d-938100e4e557-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-run-netns\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-ovn\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-systemd-units\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c86124b9-2208-42b3-8365-9c0b4bd09e26-konnectivity-ca\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2247955b-3ca6-419f-9173-b0f85c6bdc1b-kubelet-config\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-netd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507830 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-var-lib-openvswitch\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-run-ovn\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507913 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/802c71df-0443-447c-b19a-1adfb72e7314-host-cni-netd\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507915 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-cni-binary-copy\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.508836 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507941 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/354705d3-adde-4fdb-b29f-59477933fca3-serviceca\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.509313 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.507963 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6b7f\" (UniqueName: \"kubernetes.io/projected/1b20c166-9167-4e40-894d-938100e4e557-kube-api-access-s6b7f\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.509313 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.508235 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1b20c166-9167-4e40-894d-938100e4e557-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.509313 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.509137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/354705d3-adde-4fdb-b29f-59477933fca3-serviceca\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.509695 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.509677 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/802c71df-0443-447c-b19a-1adfb72e7314-ovn-node-metrics-cert\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.509955 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.509937 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c86124b9-2208-42b3-8365-9c0b4bd09e26-agent-certs\") pod \"konnectivity-agent-2zbzb\" (UID: \"c86124b9-2208-42b3-8365-9c0b4bd09e26\") " pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.515024 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.515001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47hqw\" (UniqueName: \"kubernetes.io/projected/802c71df-0443-447c-b19a-1adfb72e7314-kube-api-access-47hqw\") pod \"ovnkube-node-7sxpr\" (UID: \"802c71df-0443-447c-b19a-1adfb72e7314\") " pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.515689 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.515670 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6b7f\" (UniqueName: \"kubernetes.io/projected/1b20c166-9167-4e40-894d-938100e4e557-kube-api-access-s6b7f\") pod \"multus-additional-cni-plugins-dp75n\" (UID: \"1b20c166-9167-4e40-894d-938100e4e557\") " pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.515751 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.515697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmd9s\" (UniqueName: \"kubernetes.io/projected/354705d3-adde-4fdb-b29f-59477933fca3-kube-api-access-bmd9s\") pod \"node-ca-k2wvd\" (UID: \"354705d3-adde-4fdb-b29f-59477933fca3\") " pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.603833 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.603756 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" Jun 08 21:57:41.614169 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.614140 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2926dcff_ef0e_497a_a7e7_0ddd59b14d94.slice/crio-588e337190281a3455c0e3d1bf06d179d22a87aa462ea497581c7852d1f69a78 WatchSource:0}: Error finding container 588e337190281a3455c0e3d1bf06d179d22a87aa462ea497581c7852d1f69a78: Status 404 returned error can't find the container with id 588e337190281a3455c0e3d1bf06d179d22a87aa462ea497581c7852d1f69a78 Jun 08 21:57:41.621906 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.621881 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" Jun 08 21:57:41.628665 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.628641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7flpz" Jun 08 21:57:41.629475 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.629453 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb33c8c0e_907f_4a28_8e5f_f7471b1ef45f.slice/crio-a4d42866d5bee88a1b59901c5deb7accb25d94c616900a7766bccac1cb2bea83 WatchSource:0}: Error finding container a4d42866d5bee88a1b59901c5deb7accb25d94c616900a7766bccac1cb2bea83: Status 404 returned error can't find the container with id a4d42866d5bee88a1b59901c5deb7accb25d94c616900a7766bccac1cb2bea83 Jun 08 21:57:41.638081 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.638060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-66spw" Jun 08 21:57:41.638195 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.638174 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03411705_2d29_4134_9ede_ade8a24b8d87.slice/crio-30a1bebb638d1ce7e4fe99efe30e1a233c5f3a6701376cebe6d197b0adb6423b WatchSource:0}: Error finding container 30a1bebb638d1ce7e4fe99efe30e1a233c5f3a6701376cebe6d197b0adb6423b: Status 404 returned error can't find the container with id 30a1bebb638d1ce7e4fe99efe30e1a233c5f3a6701376cebe6d197b0adb6423b Jun 08 21:57:41.644939 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.644922 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vvx7d" Jun 08 21:57:41.646415 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.646394 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e71d9a_7855_47a5_9cd7_a5ec09616e8e.slice/crio-8e14a1553cac5a21907050612a8ce656b992a1db92a1b2806e315f1800e032a0 WatchSource:0}: Error finding container 8e14a1553cac5a21907050612a8ce656b992a1db92a1b2806e315f1800e032a0: Status 404 returned error can't find the container with id 8e14a1553cac5a21907050612a8ce656b992a1db92a1b2806e315f1800e032a0 Jun 08 21:57:41.650445 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.650426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:57:41.653264 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.653244 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1248aa9_d0c7_41f9_b502_1013aef626d6.slice/crio-0719c009e54adf574fef5c8be972f8ed4730a7eb58c27211a966a4898942d15a WatchSource:0}: Error finding container 0719c009e54adf574fef5c8be972f8ed4730a7eb58c27211a966a4898942d15a: Status 404 returned error can't find the container with id 0719c009e54adf574fef5c8be972f8ed4730a7eb58c27211a966a4898942d15a Jun 08 21:57:41.655380 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.655364 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:57:41.658682 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.658662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod802c71df_0443_447c_b19a_1adfb72e7314.slice/crio-978cb87ebf571d3fdbbdc08e37ddc8f0025135575a324582728f87552be8ae9c WatchSource:0}: Error finding container 978cb87ebf571d3fdbbdc08e37ddc8f0025135575a324582728f87552be8ae9c: Status 404 returned error can't find the container with id 978cb87ebf571d3fdbbdc08e37ddc8f0025135575a324582728f87552be8ae9c Jun 08 21:57:41.660993 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.660976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k2wvd" Jun 08 21:57:41.664714 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.664693 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc86124b9_2208_42b3_8365_9c0b4bd09e26.slice/crio-83f47cef935e9818fbe9fb6ddae98ef112ac02b99e0ac6c9ab02f2d5d5a6125d WatchSource:0}: Error finding container 83f47cef935e9818fbe9fb6ddae98ef112ac02b99e0ac6c9ab02f2d5d5a6125d: Status 404 returned error can't find the container with id 83f47cef935e9818fbe9fb6ddae98ef112ac02b99e0ac6c9ab02f2d5d5a6125d Jun 08 21:57:41.665237 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.665218 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dp75n" Jun 08 21:57:41.670609 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.670593 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod354705d3_adde_4fdb_b29f_59477933fca3.slice/crio-e5de5fda31380667e8eeeb23034d627b33fe9252f4c816b0b9c18750923acbcf WatchSource:0}: Error finding container e5de5fda31380667e8eeeb23034d627b33fe9252f4c816b0b9c18750923acbcf: Status 404 returned error can't find the container with id e5de5fda31380667e8eeeb23034d627b33fe9252f4c816b0b9c18750923acbcf Jun 08 21:57:41.674332 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:57:41.674312 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b20c166_9167_4e40_894d_938100e4e557.slice/crio-d8c3419598bab21cd2cae29e6829d8227e231da5c07e8e6feb784712c4652c74 WatchSource:0}: Error finding container d8c3419598bab21cd2cae29e6829d8227e231da5c07e8e6feb784712c4652c74: Status 404 returned error can't find the container with id d8c3419598bab21cd2cae29e6829d8227e231da5c07e8e6feb784712c4652c74 Jun 08 21:57:41.911519 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.911450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:41.911646 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:41.911537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:41.911698 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.911667 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:41.911698 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.911687 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:41.911757 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.911700 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:41.911757 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.911755 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:42.911734923 +0000 UTC m=+3.034784713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:41.912172 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.912144 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:41.912278 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:41.912202 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:42.912189262 +0000 UTC m=+3.035239050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:42.012613 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.012580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:42.012782 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.012747 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:42.012850 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.012800 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:57:43.012783631 +0000 UTC m=+3.135833426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:42.347061 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.346976 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:52:41 +0000 UTC" deadline="2028-01-07 19:16:27.147858884 +0000 UTC" Jun 08 21:57:42.347061 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.347016 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13869h18m44.800847789s" Jun 08 21:57:42.361517 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.361493 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:42.401257 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.401224 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2wvd" event={"ID":"354705d3-adde-4fdb-b29f-59477933fca3","Type":"ContainerStarted","Data":"e5de5fda31380667e8eeeb23034d627b33fe9252f4c816b0b9c18750923acbcf"} Jun 08 21:57:42.405283 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.405211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvx7d" event={"ID":"a1248aa9-d0c7-41f9-b502-1013aef626d6","Type":"ContainerStarted","Data":"0719c009e54adf574fef5c8be972f8ed4730a7eb58c27211a966a4898942d15a"} Jun 08 21:57:42.427114 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.427082 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66spw" event={"ID":"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e","Type":"ContainerStarted","Data":"8e14a1553cac5a21907050612a8ce656b992a1db92a1b2806e315f1800e032a0"} Jun 08 21:57:42.434480 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.434410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7flpz" event={"ID":"03411705-2d29-4134-9ede-ade8a24b8d87","Type":"ContainerStarted","Data":"30a1bebb638d1ce7e4fe99efe30e1a233c5f3a6701376cebe6d197b0adb6423b"} Jun 08 21:57:42.454966 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.454740 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" event={"ID":"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f","Type":"ContainerStarted","Data":"a4d42866d5bee88a1b59901c5deb7accb25d94c616900a7766bccac1cb2bea83"} Jun 08 21:57:42.459820 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.459794 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerStarted","Data":"d8c3419598bab21cd2cae29e6829d8227e231da5c07e8e6feb784712c4652c74"} Jun 08 21:57:42.462181 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.462158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zbzb" event={"ID":"c86124b9-2208-42b3-8365-9c0b4bd09e26","Type":"ContainerStarted","Data":"83f47cef935e9818fbe9fb6ddae98ef112ac02b99e0ac6c9ab02f2d5d5a6125d"} Jun 08 21:57:42.465116 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.465092 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"978cb87ebf571d3fdbbdc08e37ddc8f0025135575a324582728f87552be8ae9c"} Jun 08 21:57:42.476802 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.476777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" event={"ID":"2926dcff-ef0e-497a-a7e7-0ddd59b14d94","Type":"ContainerStarted","Data":"588e337190281a3455c0e3d1bf06d179d22a87aa462ea497581c7852d1f69a78"} Jun 08 21:57:42.570209 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.570178 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:42.918512 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.918479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:42.918673 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:42.918555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:42.918756 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.918739 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:42.918817 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.918764 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:42.918817 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.918777 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:42.918942 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.918850 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:44.918832139 +0000 UTC m=+5.041881933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:42.919289 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.919269 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:42.919367 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:42.919324 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:44.919309071 +0000 UTC m=+5.042358859 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:43.019574 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.019537 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:43.019753 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:43.019678 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:43.019753 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:43.019736 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:57:45.019717984 +0000 UTC m=+5.142767778 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:43.242548 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.242475 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 21:57:43.347479 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.347410 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 21:52:41 +0000 UTC" deadline="2028-01-01 20:11:39.158182178 +0000 UTC" Jun 08 21:57:43.347479 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.347478 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13726h13m55.810708332s" Jun 08 21:57:43.372000 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.371973 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:43.372134 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:43.372094 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:43.372533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.372516 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:43.372628 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:43.372608 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:43.372706 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:43.372676 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:43.372798 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:43.372755 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:44.938123 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:44.938073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:44.938521 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:44.938143 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:44.938521 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938270 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:44.938521 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938326 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:48.938308373 +0000 UTC m=+9.061358177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:44.938742 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938711 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:44.938742 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938742 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:44.938899 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938754 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:44.938899 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:44.938799 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:48.938784925 +0000 UTC m=+9.061834716 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:45.039272 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:45.039233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:45.039465 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:45.039420 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:45.039531 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:45.039486 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:57:49.039467723 +0000 UTC m=+9.162517526 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:45.371533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:45.371461 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:45.371701 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:45.371588 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:45.371701 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:45.371648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:45.371853 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:45.371733 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:45.371853 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:45.371773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:45.371853 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:45.371835 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:47.371038 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:47.370995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:47.371528 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:47.371121 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:47.371528 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:47.371503 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:47.371662 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:47.371616 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:47.371719 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:47.371669 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:47.371814 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:47.371744 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:48.976088 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:48.976169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976322 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976341 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976353 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976402 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:56.976382339 +0000 UTC m=+17.099432147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976822 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:48.976929 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:48.976889 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:57:56.976857265 +0000 UTC m=+17.099907059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:49.076806 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:49.076694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:49.076974 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:49.076860 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:49.076974 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:49.076947 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:57:57.07692729 +0000 UTC m=+17.199977084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:49.371593 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:49.371711 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:49.371722 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:49.371752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:49.371885 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:49.372135 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:49.371995 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:51.371712 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:51.371672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:51.372198 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:51.371716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:51.372198 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:51.371716 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:51.372198 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:51.371814 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:51.372198 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:51.371932 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:51.372198 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:51.372006 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:53.371448 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:53.371417 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:53.371958 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:53.371511 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:53.371958 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:53.371526 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:53.371958 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:53.371592 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:53.371958 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:53.371610 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:53.371958 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:53.371684 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:55.371056 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:55.371025 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:55.371452 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:55.371025 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:55.371452 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:55.371145 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:55.371452 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:55.371031 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:55.371452 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:55.371207 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:55.371452 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:55.371273 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:57.039229 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.039187 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.039277 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039318 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039372 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039385 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039387 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:13.039367243 +0000 UTC m=+33.162417034 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039397 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:57.039654 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.039430 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:13.039419827 +0000 UTC m=+33.162469615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:57:57.140420 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.140380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:57.140591 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.140501 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:57.140591 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.140575 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:58:13.140555365 +0000 UTC m=+33.263605156 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:57:57.372100 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.372034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:57.372237 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.372131 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:57.372237 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.372140 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:57.372237 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:57.372159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:57.372338 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.372248 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:57:57.372338 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:57.372311 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:59.371842 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:59.371810 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:57:59.372263 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:59.371944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:57:59.372263 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:57:59.371969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:57:59.372263 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:59.371945 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:57:59.372263 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:59.372060 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:57:59.372263 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:57:59.372128 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:01.371959 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:01.371927 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:01.371959 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:01.371960 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:01.372475 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:01.371968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:01.372475 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:01.372041 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:01.372475 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:01.372169 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:01.372475 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:01.372267 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:02.524306 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.524056 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" event={"ID":"56554d0b4ec320ab1a2afe7ff9f853be","Type":"ContainerStarted","Data":"efc9af651f020eeabab24ba51ab7a9e88b8947871ae4ac295e05aa0e093c2290"} Jun 08 21:58:02.525504 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.525481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-66spw" event={"ID":"b8e71d9a-7855-47a5-9cd7-a5ec09616e8e","Type":"ContainerStarted","Data":"d60fc2311f349035c5e99b934cdfc59822e493d85b209e26a76b0666fe020390"} Jun 08 21:58:02.526913 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.526889 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" event={"ID":"b33c8c0e-907f-4a28-8e5f-f7471b1ef45f","Type":"ContainerStarted","Data":"cad03f41da26ea9e0388e335fc92061b4dc71decfddfd7ba000de02ee17298a4"} Jun 08 21:58:02.537458 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.537410 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-66.ec2.internal" podStartSLOduration=21.537397834 podStartE2EDuration="21.537397834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:02.536773357 +0000 UTC m=+22.659823163" watchObservedRunningTime="2026-06-08 21:58:02.537397834 +0000 UTC m=+22.660447644" Jun 08 21:58:02.551195 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.551153 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-66spw" podStartSLOduration=2.05838489 podStartE2EDuration="22.551140184s" totalImagesPullingTime="20.492755294s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:02.550957612 +0000 UTC m=+22.674007421" watchObservedRunningTime="2026-06-08 21:58:02.551140184 +0000 UTC m=+22.674189993" Jun 08 21:58:02.568567 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:02.568526 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mzwn9" podStartSLOduration=2.060060777 podStartE2EDuration="22.568511581s" totalImagesPullingTime="20.508450804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:02.568285476 +0000 UTC m=+22.691335286" watchObservedRunningTime="2026-06-08 21:58:02.568511581 +0000 UTC m=+22.691561391" Jun 08 21:58:03.371267 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.371102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:03.371399 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.371102 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:03.371399 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:03.371384 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:03.371513 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.371132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:03.371513 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:03.371423 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:03.371607 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:03.371513 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:03.530165 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.530133 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7flpz" event={"ID":"03411705-2d29-4134-9ede-ade8a24b8d87","Type":"ContainerStarted","Data":"007450d4e9024512cf27779feb64f0d2773ce761943af23c17c14101732d0efb"} Jun 08 21:58:03.531975 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.531948 2562 generic.go:356] "Generic (PLEG): container finished" podID="e373c95bf2111aa8746e7ecc77167f5c" containerID="8370ac04c33382c8f0d38282f8aebd12334c2e5776c1718edd515714537c4ad7" exitCode=0 Jun 08 21:58:03.532085 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.532023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" event={"ID":"e373c95bf2111aa8746e7ecc77167f5c","Type":"ContainerDied","Data":"8370ac04c33382c8f0d38282f8aebd12334c2e5776c1718edd515714537c4ad7"} Jun 08 21:58:03.533785 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.533765 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="fa91022497ef01a747fa3d26ba3bc0f9e783298bdb85360651a22b389c98dd5f" exitCode=0 Jun 08 21:58:03.533920 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.533828 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"fa91022497ef01a747fa3d26ba3bc0f9e783298bdb85360651a22b389c98dd5f"} Jun 08 21:58:03.535771 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.535421 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2zbzb" event={"ID":"c86124b9-2208-42b3-8365-9c0b4bd09e26","Type":"ContainerStarted","Data":"4c13c90f62ac902b08fb01b2ed9cca99178e9597fc72e51cc3dfd86683e01f6d"} Jun 08 21:58:03.538888 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.538851 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 21:58:03.539205 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539188 2562 generic.go:356] "Generic (PLEG): container finished" podID="802c71df-0443-447c-b19a-1adfb72e7314" containerID="8b6d8e7a0e7031530086b601543933c1c3078fc71f86ee90aa07d13bf3d12aab" exitCode=1 Jun 08 21:58:03.539262 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539244 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"b741c3cb6aabc24a6d430d08a9e26527eab24d0e16ed44644769051380843a9f"} Jun 08 21:58:03.539335 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539321 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"87c825a5a0d8c4026c674b9ca84c3ee6e6eabfe679e7f7379075507ecee6df6e"} Jun 08 21:58:03.539389 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"acf2429f1307f3f9b9376dcd6098ecfc3d76d184fcb0effb6df5ade37671e558"} Jun 08 21:58:03.539464 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539452 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"1858fdc8d447c60414a107e78782d88b16bbfafbd67bd745eb74868416d020f7"} Jun 08 21:58:03.539517 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539495 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerDied","Data":"8b6d8e7a0e7031530086b601543933c1c3078fc71f86ee90aa07d13bf3d12aab"} Jun 08 21:58:03.539554 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.539539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"2e79fdaddff9589450ccf4053bba888322a9fdb6735e019cc75bcc32de7a9b4e"} Jun 08 21:58:03.541022 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.540999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" event={"ID":"2926dcff-ef0e-497a-a7e7-0ddd59b14d94","Type":"ContainerStarted","Data":"d7aeacd48ba68aec1c0945c6931c2becec3e6a7af1c98848f163f2c5396f1fa0"} Jun 08 21:58:03.542481 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.542460 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k2wvd" event={"ID":"354705d3-adde-4fdb-b29f-59477933fca3","Type":"ContainerStarted","Data":"1948a908062219efced274ac99f75ce02a410ab3c49e0d7399d7ba977642b88d"} Jun 08 21:58:03.545660 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.545619 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7flpz" podStartSLOduration=3.234297705 podStartE2EDuration="23.545608563s" totalImagesPullingTime="20.311310858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:03.545277645 +0000 UTC m=+23.668327454" watchObservedRunningTime="2026-06-08 21:58:03.545608563 +0000 UTC m=+23.668658373" Jun 08 21:58:03.546538 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.546518 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vvx7d" event={"ID":"a1248aa9-d0c7-41f9-b502-1013aef626d6","Type":"ContainerStarted","Data":"aaf81ebe758a04d1ad31ce0d8a609bf21707ce9647874a1d48221ccda4169a26"} Jun 08 21:58:03.557979 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.557854 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k2wvd" podStartSLOduration=3.27921384 podStartE2EDuration="23.557839771s" totalImagesPullingTime="20.278625931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:03.557368156 +0000 UTC m=+23.680417968" watchObservedRunningTime="2026-06-08 21:58:03.557839771 +0000 UTC m=+23.680889581" Jun 08 21:58:03.607927 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.607742 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2zbzb" podStartSLOduration=3.323841758 podStartE2EDuration="23.607726261s" totalImagesPullingTime="20.283884503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:03.607271516 +0000 UTC m=+23.730321327" watchObservedRunningTime="2026-06-08 21:58:03.607726261 +0000 UTC m=+23.730776070" Jun 08 21:58:03.620829 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:03.620786 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vvx7d" podStartSLOduration=3.134856913 podStartE2EDuration="23.620769141s" totalImagesPullingTime="20.485912228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:03.620483083 +0000 UTC m=+23.743532894" watchObservedRunningTime="2026-06-08 21:58:03.620769141 +0000 UTC m=+23.743818999" Jun 08 21:58:04.551765 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:04.551679 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" event={"ID":"e373c95bf2111aa8746e7ecc77167f5c","Type":"ContainerStarted","Data":"a7a9b350c1479ae454a6e6bd2216b50934871c58d78918b0b2cb570c4b6c593b"} Jun 08 21:58:04.564960 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:04.564911 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-66.ec2.internal" podStartSLOduration=23.564892638 podStartE2EDuration="23.564892638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:04.564545232 +0000 UTC m=+24.687595043" watchObservedRunningTime="2026-06-08 21:58:04.564892638 +0000 UTC m=+24.687942445" Jun 08 21:58:04.829134 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:04.829101 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 21:58:05.371768 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.371742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:05.371980 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.371742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:05.371980 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:05.371892 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:05.372106 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.371739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:05.372106 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:05.372018 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:05.372200 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:05.372134 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:05.372811 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.372719 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T21:58:04.829128489Z","UUID":"da2095ad-0ee5-42ba-a9e4-a74749401958","Handler":null,"Name":"","Endpoint":""} Jun 08 21:58:05.375307 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.375287 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 21:58:05.375446 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.375339 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 21:58:05.483580 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.483551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:58:05.484261 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.484235 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:58:05.557168 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:05.556737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" event={"ID":"2926dcff-ef0e-497a-a7e7-0ddd59b14d94","Type":"ContainerStarted","Data":"8df7357bc45ed97fdf6fd0cc6220a016036099b335b57335783ec539392d80f1"} Jun 08 21:58:06.008854 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:06.008818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:58:06.009507 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:06.009472 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2zbzb" Jun 08 21:58:06.561705 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:06.561677 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 21:58:06.562262 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:06.562062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"60a612193faf80dd4fd701e95d809926390f530f4220721e289df278d0acbe79"} Jun 08 21:58:06.564315 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:06.564285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" event={"ID":"2926dcff-ef0e-497a-a7e7-0ddd59b14d94","Type":"ContainerStarted","Data":"aa5abcb7c4dba2f44475087bf0b10c5bb1b52a955055338f3c6c900bd1e7b801"} Jun 08 21:58:07.371466 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:07.371435 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:07.371466 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:07.371468 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:07.371710 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:07.371437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:07.371710 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:07.371549 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:07.371710 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:07.371617 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:07.371710 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:07.371685 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:08.570685 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.570651 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="50c9cece9e93a3030c758bad14718cd0d08652a6d6dbbca9f9e80fa73e4e7b7d" exitCode=0 Jun 08 21:58:08.571147 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.570737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"50c9cece9e93a3030c758bad14718cd0d08652a6d6dbbca9f9e80fa73e4e7b7d"} Jun 08 21:58:08.574118 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.574096 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 21:58:08.574483 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.574451 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"adb5a9bf2abaefc03061692fdeb62d9580667072aac2311a6d982e6c6ae61c22"} Jun 08 21:58:08.574732 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.574712 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:08.574825 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.574779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:08.574911 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.574894 2562 scope.go:117] "RemoveContainer" containerID="8b6d8e7a0e7031530086b601543933c1c3078fc71f86ee90aa07d13bf3d12aab" Jun 08 21:58:08.590580 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.590562 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:08.594428 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:08.592294 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-twhkl" podStartSLOduration=6.091399853 podStartE2EDuration="28.592277501s" totalImagesPullingTime="22.500877648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:06.581180442 +0000 UTC m=+26.704230251" watchObservedRunningTime="2026-06-08 21:58:08.592277501 +0000 UTC m=+28.715327311" Jun 08 21:58:09.372081 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.371929 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:09.372316 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.371951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:09.372316 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.372159 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:09.372316 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.371951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:09.372316 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.372275 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:09.372463 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.372351 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:09.583726 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.583259 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 21:58:09.584219 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.583908 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" event={"ID":"802c71df-0443-447c-b19a-1adfb72e7314","Type":"ContainerStarted","Data":"7e98c5a60f920588f8ec1d4f7c8b6180783e97750c818dee0c5775f2bb8f2b3d"} Jun 08 21:58:09.585078 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.585056 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:09.603774 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.603753 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:09.611306 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.611266 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" podStartSLOduration=8.57639492 podStartE2EDuration="29.611249532s" totalImagesPullingTime="21.034854612s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:09.610400933 +0000 UTC m=+29.733450746" watchObservedRunningTime="2026-06-08 21:58:09.611249532 +0000 UTC m=+29.734299342" Jun 08 21:58:09.787903 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.787848 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sljn"] Jun 08 21:58:09.788069 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.787978 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:09.788132 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.788081 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:09.788979 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.788958 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcxh4"] Jun 08 21:58:09.789079 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.789056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:09.789148 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.789103 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fvwx"] Jun 08 21:58:09.789183 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.789157 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:09.789183 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:09.789177 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:09.789264 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:09.789249 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:10.588289 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:10.588255 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="3e8dd8a8fd2caf01950717cf740fd11a0ed9e92958c4f2a8a6e845f4d3418eda" exitCode=0 Jun 08 21:58:10.588841 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:10.588342 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"3e8dd8a8fd2caf01950717cf740fd11a0ed9e92958c4f2a8a6e845f4d3418eda"} Jun 08 21:58:11.371817 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:11.371778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:11.371817 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:11.371813 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:11.372042 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:11.371929 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:11.372042 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:11.371976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:11.372106 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:11.372076 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:11.372171 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:11.372152 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:12.335498 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.335325 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:12.428452 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.428417 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:12.496832 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.496789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:12.595023 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.594922 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="32894d1d7b4607e2d183610afcd50377bd80f5bdd48a9985aa37a696d6744a72" exitCode=0 Jun 08 21:58:12.595023 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.594975 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"32894d1d7b4607e2d183610afcd50377bd80f5bdd48a9985aa37a696d6744a72"} Jun 08 21:58:12.808409 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.808375 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:12.909847 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:12.909761 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:13.061950 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.061917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:13.062111 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.062005 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:13.062173 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062105 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:58:13.062173 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062143 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 21:58:13.062173 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062160 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 21:58:13.062173 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062172 2562 projected.go:196] Error preparing data for projected volume kube-api-access-hhjl4 for pod openshift-network-diagnostics/network-check-target-tcxh4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:58:13.062315 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062191 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:45.062167764 +0000 UTC m=+65.185217553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 21:58:13.062315 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.062221 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4 podName:a7654612-12fc-423f-9530-b46da5fb1e70 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:45.06220508 +0000 UTC m=+65.185254874 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hhjl4" (UniqueName: "kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4") pod "network-check-target-tcxh4" (UID: "a7654612-12fc-423f-9530-b46da5fb1e70") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 21:58:13.162987 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.162900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:13.163121 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.163021 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 21:58:13.163121 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.163083 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret podName:2247955b-3ca6-419f-9173-b0f85c6bdc1b nodeName:}" failed. No retries permitted until 2026-06-08 21:58:45.163062565 +0000 UTC m=+65.286112356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret") pod "global-pull-secret-syncer-2sljn" (UID: "2247955b-3ca6-419f-9173-b0f85c6bdc1b") : object "kube-system"/"original-pull-secret" not registered Jun 08 21:58:13.371118 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.371083 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:13.371118 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.371117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:13.371564 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:13.371241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:13.371564 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.371252 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:13.371564 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.371327 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:13.371564 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:13.371418 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:14.867585 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:14.867509 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:14.965656 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:14.965621 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:15.371945 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:15.371914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:15.372110 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:15.371918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:15.372110 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:15.372037 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-2sljn" podUID="2247955b-3ca6-419f-9173-b0f85c6bdc1b" Jun 08 21:58:15.372231 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:15.372139 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 21:58:15.372231 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:15.371918 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:15.372333 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:15.372236 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tcxh4" podUID="a7654612-12fc-423f-9530-b46da5fb1e70" Jun 08 21:58:15.612008 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:15.611976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:15.711412 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:15.711368 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:16.192534 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.192506 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-66.ec2.internal" event="NodeReady" Jun 08 21:58:16.192997 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.192674 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 21:58:16.236460 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.236388 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-rjc5n"] Jun 08 21:58:16.241769 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.241742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.242812 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.242788 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-22jqd"] Jun 08 21:58:16.243835 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.243667 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 21:58:16.243835 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.243737 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fmxnl\"" Jun 08 21:58:16.243997 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.243938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 21:58:16.246097 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.246077 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.247756 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.247739 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjc5n"] Jun 08 21:58:16.248456 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.248436 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 21:58:16.248657 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.248629 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 21:58:16.248819 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.248802 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 21:58:16.249115 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.249078 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xf2xt\"" Jun 08 21:58:16.254701 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.254680 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22jqd"] Jun 08 21:58:16.383703 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqz6w\" (UniqueName: \"kubernetes.io/projected/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-kube-api-access-bqz6w\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.383846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383733 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l27l6\" (UniqueName: \"kubernetes.io/projected/74a2419c-b62a-490b-83f5-299136bde102-kube-api-access-l27l6\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.383846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74a2419c-b62a-490b-83f5-299136bde102-cert\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.383846 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383829 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-tmp-dir\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.384003 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383849 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-config-volume\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.384003 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.383887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.485089 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqz6w\" (UniqueName: \"kubernetes.io/projected/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-kube-api-access-bqz6w\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.485275 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l27l6\" (UniqueName: \"kubernetes.io/projected/74a2419c-b62a-490b-83f5-299136bde102-kube-api-access-l27l6\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.485275 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74a2419c-b62a-490b-83f5-299136bde102-cert\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.485275 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485195 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-tmp-dir\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.485275 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-config-volume\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.485275 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.485514 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:16.485355 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:16.485514 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:16.485415 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:16.985398377 +0000 UTC m=+37.108448179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:16.485588 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.485560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-tmp-dir\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.486040 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.486010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-config-volume\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.489433 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.489383 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74a2419c-b62a-490b-83f5-299136bde102-cert\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.493676 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.493648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqz6w\" (UniqueName: \"kubernetes.io/projected/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-kube-api-access-bqz6w\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.493771 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.493660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l27l6\" (UniqueName: \"kubernetes.io/projected/74a2419c-b62a-490b-83f5-299136bde102-kube-api-access-l27l6\") pod \"ingress-canary-22jqd\" (UID: \"74a2419c-b62a-490b-83f5-299136bde102\") " pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.562971 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.562956 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-22jqd" Jun 08 21:58:16.707256 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.706997 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-22jqd"] Jun 08 21:58:16.712308 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:58:16.712281 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74a2419c_b62a_490b_83f5_299136bde102.slice/crio-218d5f08aced31d83c8835c9ebce6a149faa80a82ad2fd3d61eeb5e3d9a4cc89 WatchSource:0}: Error finding container 218d5f08aced31d83c8835c9ebce6a149faa80a82ad2fd3d61eeb5e3d9a4cc89: Status 404 returned error can't find the container with id 218d5f08aced31d83c8835c9ebce6a149faa80a82ad2fd3d61eeb5e3d9a4cc89 Jun 08 21:58:16.988333 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:16.988295 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:16.988496 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:16.988444 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:16.988541 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:16.988507 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:17.98849077 +0000 UTC m=+38.111540574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:17.371650 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.371611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:17.372113 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.371615 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:17.372113 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.371624 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:17.375223 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375202 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:58:17.375328 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375211 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:58:17.375328 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wrq9n\"" Jun 08 21:58:17.375396 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375385 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:58:17.375449 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375437 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:58:17.375507 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.375492 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-spnwc\"" Jun 08 21:58:17.608294 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.608251 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22jqd" event={"ID":"74a2419c-b62a-490b-83f5-299136bde102","Type":"ContainerStarted","Data":"218d5f08aced31d83c8835c9ebce6a149faa80a82ad2fd3d61eeb5e3d9a4cc89"} Jun 08 21:58:17.611504 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.611474 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"9ff89c757b2953a38b9793b5244acaf37f0ebf06f3a0fe2e4b281414c8f7235a"} Jun 08 21:58:17.611632 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.611385 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="9ff89c757b2953a38b9793b5244acaf37f0ebf06f3a0fe2e4b281414c8f7235a" exitCode=0 Jun 08 21:58:17.997614 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:17.997580 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:17.997794 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:17.997749 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:17.997849 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:17.997824 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:19.997802217 +0000 UTC m=+40.120852005 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:18.615222 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:18.615147 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-22jqd" event={"ID":"74a2419c-b62a-490b-83f5-299136bde102","Type":"ContainerStarted","Data":"495d4e2f19435ff597f3bae7fc5f196b8ced2511135f0115e83d98cf2d53eb06"} Jun 08 21:58:18.618117 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:18.618085 2562 generic.go:356] "Generic (PLEG): container finished" podID="1b20c166-9167-4e40-894d-938100e4e557" containerID="9551b3a9ee0135e982f5e5266825294b4f2ca19b22c71b26ab898c7db8de7322" exitCode=0 Jun 08 21:58:18.618218 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:18.618145 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerDied","Data":"9551b3a9ee0135e982f5e5266825294b4f2ca19b22c71b26ab898c7db8de7322"} Jun 08 21:58:18.630657 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:18.630620 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-22jqd" podStartSLOduration=1.104414327 podStartE2EDuration="2.630607408s" totalImagesPullingTime="1.526193081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:18.629331598 +0000 UTC m=+38.752381407" watchObservedRunningTime="2026-06-08 21:58:18.630607408 +0000 UTC m=+38.753657255" Jun 08 21:58:19.623582 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:19.623356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dp75n" event={"ID":"1b20c166-9167-4e40-894d-938100e4e557","Type":"ContainerStarted","Data":"0812601e41f8ea7b8ca679cb5872272d95ea096f07db21f8925f246788728f8c"} Jun 08 21:58:19.783220 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:19.783185 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:19.855704 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:19.855674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:19.926798 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:19.926740 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:20.013177 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:20.013152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:20.013274 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:20.013253 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:20.013310 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:20.013302 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:24.013289437 +0000 UTC m=+44.136339225 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:24.040317 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:24.040286 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:24.040736 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:24.040404 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:24.040736 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:24.040452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:32.040439675 +0000 UTC m=+52.163489463 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:25.542112 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.542061 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dp75n" podStartSLOduration=15.051267959 podStartE2EDuration="45.542045182s" totalImagesPullingTime="30.490777223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:19.654349933 +0000 UTC m=+39.777399741" watchObservedRunningTime="2026-06-08 21:58:25.542045182 +0000 UTC m=+45.665095056" Jun 08 21:58:25.542541 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.542210 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn"] Jun 08 21:58:25.579827 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.579805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn"] Jun 08 21:58:25.579971 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.579911 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.582127 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.582102 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 21:58:25.582259 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.582237 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 08 21:58:25.582340 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.582324 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 21:58:25.582400 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.582346 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 21:58:25.752761 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.752728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d4ba163-3749-4b81-860d-43ccad37329f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.752943 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.752795 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdc69\" (UniqueName: \"kubernetes.io/projected/4d4ba163-3749-4b81-860d-43ccad37329f-kube-api-access-jdc69\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.752943 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.752896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4ba163-3749-4b81-860d-43ccad37329f-tmp\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.853525 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.853452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdc69\" (UniqueName: \"kubernetes.io/projected/4d4ba163-3749-4b81-860d-43ccad37329f-kube-api-access-jdc69\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.853525 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.853496 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4ba163-3749-4b81-860d-43ccad37329f-tmp\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.853737 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.853528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d4ba163-3749-4b81-860d-43ccad37329f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.853992 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.853972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4d4ba163-3749-4b81-860d-43ccad37329f-tmp\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.857319 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.857301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/4d4ba163-3749-4b81-860d-43ccad37329f-klusterlet-config\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.861932 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.861910 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdc69\" (UniqueName: \"kubernetes.io/projected/4d4ba163-3749-4b81-860d-43ccad37329f-kube-api-access-jdc69\") pod \"klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn\" (UID: \"4d4ba163-3749-4b81-860d-43ccad37329f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:25.888633 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:25.888612 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:26.041596 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:26.039761 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn"] Jun 08 21:58:26.043268 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:58:26.043238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d4ba163_3749_4b81_860d_43ccad37329f.slice/crio-9863b4f83ebf8edff4476465a265a9ec6af7b3001ebb81cbd69b06d418a5c5ee WatchSource:0}: Error finding container 9863b4f83ebf8edff4476465a265a9ec6af7b3001ebb81cbd69b06d418a5c5ee: Status 404 returned error can't find the container with id 9863b4f83ebf8edff4476465a265a9ec6af7b3001ebb81cbd69b06d418a5c5ee Jun 08 21:58:26.640097 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:26.640062 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerStarted","Data":"9863b4f83ebf8edff4476465a265a9ec6af7b3001ebb81cbd69b06d418a5c5ee"} Jun 08 21:58:30.652739 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:30.652710 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerStarted","Data":"4e381e36d4c3a03d97b15f3ff0ef7417056a277af04e0db4fd50f55a71e7a20b"} Jun 08 21:58:31.656418 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:31.656377 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:31.658030 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:31.658003 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 21:58:31.672506 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:31.672461 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" podStartSLOduration=2.16446106 podStartE2EDuration="6.672448917s" totalImagesPullingTime="4.507987857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:31.671529019 +0000 UTC m=+51.794578829" watchObservedRunningTime="2026-06-08 21:58:31.672448917 +0000 UTC m=+51.795498726" Jun 08 21:58:32.101246 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:32.101205 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:32.101449 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:32.101323 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:32.101449 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:32.101392 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:58:48.101378285 +0000 UTC m=+68.224428073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:35.292790 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:35.292752 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:35.349284 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:35.349259 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:36.860613 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:36.860585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:36.929403 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:36.929373 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:41.600950 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:41.600922 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7sxpr" Jun 08 21:58:41.716344 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:41.716311 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:41.775078 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:41.775056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:45.085261 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.085227 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:45.085628 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.085284 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:58:45.090170 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.090153 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 21:58:45.090258 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.090239 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 21:58:45.096092 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:45.096073 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:58:45.096147 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:45.096136 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 21:59:49.09612079 +0000 UTC m=+129.219170577 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : secret "metrics-daemon-secret" not found Jun 08 21:58:45.098049 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.098035 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 21:58:45.109311 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.109288 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhjl4\" (UniqueName: \"kubernetes.io/projected/a7654612-12fc-423f-9530-b46da5fb1e70-kube-api-access-hhjl4\") pod \"network-check-target-tcxh4\" (UID: \"a7654612-12fc-423f-9530-b46da5fb1e70\") " pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:45.186328 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.186298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:45.188429 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.188415 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 21:58:45.199226 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.199204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2247955b-3ca6-419f-9173-b0f85c6bdc1b-original-pull-secret\") pod \"global-pull-secret-syncer-2sljn\" (UID: \"2247955b-3ca6-419f-9173-b0f85c6bdc1b\") " pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:45.284617 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.284598 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-spnwc\"" Jun 08 21:58:45.293481 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.293465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:45.296147 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.296132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-2sljn" Jun 08 21:58:45.456817 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.456787 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-2sljn"] Jun 08 21:58:45.462767 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.462748 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tcxh4"] Jun 08 21:58:45.465973 ip-10-0-140-66 kubenswrapper[2562]: W0608 21:58:45.465936 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7654612_12fc_423f_9530_b46da5fb1e70.slice/crio-36d209d9c2e36c62334fd62cad37bd7b91d8374ed2bee2a59143382f728d7a41 WatchSource:0}: Error finding container 36d209d9c2e36c62334fd62cad37bd7b91d8374ed2bee2a59143382f728d7a41: Status 404 returned error can't find the container with id 36d209d9c2e36c62334fd62cad37bd7b91d8374ed2bee2a59143382f728d7a41 Jun 08 21:58:45.690619 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.690529 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcxh4" event={"ID":"a7654612-12fc-423f-9530-b46da5fb1e70","Type":"ContainerStarted","Data":"36d209d9c2e36c62334fd62cad37bd7b91d8374ed2bee2a59143382f728d7a41"} Jun 08 21:58:45.691533 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:45.691510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sljn" event={"ID":"2247955b-3ca6-419f-9173-b0f85c6bdc1b","Type":"ContainerStarted","Data":"8ea3232e4fe1690eb8d7551f46137b0398125f9187525c353c6c04539fed3d8e"} Jun 08 21:58:48.108092 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:48.108047 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:58:48.108549 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:48.108205 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:58:48.108549 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:58:48.108287 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 21:59:20.108265343 +0000 UTC m=+100.231315136 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:58:49.606805 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:49.606771 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:49.661095 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:49.661058 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:58:50.706768 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:50.706725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-2sljn" event={"ID":"2247955b-3ca6-419f-9173-b0f85c6bdc1b","Type":"ContainerStarted","Data":"be677e76a38f96536a115b370d2bfb4b29fe925a3814e85aceb58a8864c48e4b"} Jun 08 21:58:50.708095 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:50.708072 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tcxh4" event={"ID":"a7654612-12fc-423f-9530-b46da5fb1e70","Type":"ContainerStarted","Data":"dde370b1804b7f71db0d4b17b8d1f5b26aaeddd6286b56b4b8aa9bff332e1173"} Jun 08 21:58:50.708218 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:50.708196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:58:50.721169 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:50.721124 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-2sljn" podStartSLOduration=66.193964748 podStartE2EDuration="1m10.721111137s" totalImagesPullingTime="4.527146389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:50.72044429 +0000 UTC m=+70.843494100" watchObservedRunningTime="2026-06-08 21:58:50.721111137 +0000 UTC m=+70.844160948" Jun 08 21:58:50.733571 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:58:50.733534 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tcxh4" podStartSLOduration=66.215879576 podStartE2EDuration="1m10.733521245s" totalImagesPullingTime="4.517641669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 21:58:50.73277221 +0000 UTC m=+70.855822021" watchObservedRunningTime="2026-06-08 21:58:50.733521245 +0000 UTC m=+70.856571063" Jun 08 21:59:11.752780 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:59:11.752739 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 21:59:20.121066 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:59:20.121025 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 21:59:20.121491 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:59:20.121172 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 21:59:20.121491 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:59:20.121259 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 22:00:24.121234034 +0000 UTC m=+164.244283822 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 21:59:21.712139 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:59:21.712110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tcxh4" Jun 08 21:59:49.112032 ip-10-0-140-66 kubenswrapper[2562]: I0608 21:59:49.111985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 21:59:49.112533 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:59:49.112115 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 21:59:49.112533 ip-10-0-140-66 kubenswrapper[2562]: E0608 21:59:49.112177 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:51.112162402 +0000 UTC m=+251.235212189 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : secret "metrics-daemon-secret" not found Jun 08 22:00:05.202114 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:05.202075 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:00:19.259086 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:00:19.259041 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rjc5n" podUID="c95acc29-4ad3-45dd-a646-2c439bd0a6e9" Jun 08 22:00:19.910737 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:19.910708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjc5n" Jun 08 22:00:20.390575 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:00:20.390543 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 22:00:24.156336 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:24.156239 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 22:00:24.156692 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:00:24.156373 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 22:00:24.156692 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:00:24.156435 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls podName:c95acc29-4ad3-45dd-a646-2c439bd0a6e9 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:26.156419967 +0000 UTC m=+286.279469756 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls") pod "dns-default-rjc5n" (UID: "c95acc29-4ad3-45dd-a646-2c439bd0a6e9") : secret "dns-default-metrics-tls" not found Jun 08 22:00:30.936935 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:30.936834 2562 generic.go:356] "Generic (PLEG): container finished" podID="4d4ba163-3749-4b81-860d-43ccad37329f" containerID="4e381e36d4c3a03d97b15f3ff0ef7417056a277af04e0db4fd50f55a71e7a20b" exitCode=1 Jun 08 22:00:30.937353 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:30.936921 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerDied","Data":"4e381e36d4c3a03d97b15f3ff0ef7417056a277af04e0db4fd50f55a71e7a20b"} Jun 08 22:00:30.937353 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:30.937306 2562 scope.go:117] "RemoveContainer" containerID="4e381e36d4c3a03d97b15f3ff0ef7417056a277af04e0db4fd50f55a71e7a20b" Jun 08 22:00:31.657182 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:31.657133 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:00:31.941839 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:31.941808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerStarted","Data":"e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1"} Jun 08 22:00:31.942237 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:31.942024 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:00:31.942590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:31.942574 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:00:35.371288 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:00:35.371252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:01:39.191372 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.191334 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:01:39.194511 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.194491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.196997 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.196975 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fkww8\"" Jun 08 22:01:39.198550 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.198533 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 08 22:01:39.198641 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.198618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 08 22:01:39.198806 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.198791 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 08 22:01:39.213054 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.213036 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 08 22:01:39.222300 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.222279 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:01:39.261587 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpn9n\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261680 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261592 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261680 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261634 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261680 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261813 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261813 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261813 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.261813 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.261764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.300716 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.300689 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j"] Jun 08 22:01:39.303417 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.303401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.307527 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.307512 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:01:39.309096 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.308952 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 08 22:01:39.309206 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.309188 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 08 22:01:39.309273 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.309206 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 08 22:01:39.309273 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.308952 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6pvtq\"" Jun 08 22:01:39.318175 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.318152 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-69667599d7-c7qmw"] Jun 08 22:01:39.321002 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.320987 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv"] Jun 08 22:01:39.321129 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.321114 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.323746 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.323728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" Jun 08 22:01:39.326211 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.326194 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j"] Jun 08 22:01:39.326999 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.326982 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 08 22:01:39.329064 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.329048 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 08 22:01:39.334377 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.334362 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-mvsvk\"" Jun 08 22:01:39.334447 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.334406 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 08 22:01:39.334967 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.334950 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 22:01:39.335043 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.335009 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 08 22:01:39.335104 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.335073 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 22:01:39.335157 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.335142 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vbdxs\"" Jun 08 22:01:39.348812 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.348774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69667599d7-c7qmw"] Jun 08 22:01:39.349585 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.349567 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv"] Jun 08 22:01:39.362267 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362359 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362359 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de9e1433-0a40-4d8a-995c-8864fbc45b05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.362482 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362409 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpn9n\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362482 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362441 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362482 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de9e1433-0a40-4d8a-995c-8864fbc45b05-config\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.362636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362530 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362545 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.362636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362603 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2qpr\" (UniqueName: \"kubernetes.io/projected/de9e1433-0a40-4d8a-995c-8864fbc45b05-kube-api-access-n2qpr\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.362898 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.362662 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:01:39.362898 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.362678 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9ccc994-tzg9q: secret "image-registry-tls" not found Jun 08 22:01:39.362898 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.362736 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls podName:1d82a344-5852-45d4-9bfe-07dea76615c0 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:39.862718305 +0000 UTC m=+239.985768093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls") pod "image-registry-77b9ccc994-tzg9q" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0") : secret "image-registry-tls" not found Jun 08 22:01:39.363052 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.362976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.363100 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.363067 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.363365 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.363346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.365321 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.365305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.365401 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.365358 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.395328 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.395300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpn9n\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.396710 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.396690 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.463535 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de9e1433-0a40-4d8a-995c-8864fbc45b05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.463535 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-default-certificate\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.463535 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de9e1433-0a40-4d8a-995c-8864fbc45b05-config\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.463535 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.463774 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463556 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpbwt\" (UniqueName: \"kubernetes.io/projected/47163887-c99e-4309-8e83-491f91e95eae-kube-api-access-vpbwt\") pod \"network-check-source-dbd9cf844-lkgzv\" (UID: \"47163887-c99e-4309-8e83-491f91e95eae\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" Jun 08 22:01:39.463774 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463662 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.463774 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463704 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2qpr\" (UniqueName: \"kubernetes.io/projected/de9e1433-0a40-4d8a-995c-8864fbc45b05-kube-api-access-n2qpr\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.463774 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463752 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-stats-auth\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.463955 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.463796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8w64\" (UniqueName: \"kubernetes.io/projected/9c08e959-7140-4322-bb8e-47c231c0af19-kube-api-access-d8w64\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.464121 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.464102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/de9e1433-0a40-4d8a-995c-8864fbc45b05-config\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.465760 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.465740 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/de9e1433-0a40-4d8a-995c-8864fbc45b05-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.488037 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.488015 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2qpr\" (UniqueName: \"kubernetes.io/projected/de9e1433-0a40-4d8a-995c-8864fbc45b05-kube-api-access-n2qpr\") pod \"service-ca-operator-6bc5ff68f5-clp6j\" (UID: \"de9e1433-0a40-4d8a-995c-8864fbc45b05\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.564627 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-stats-auth\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.564765 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8w64\" (UniqueName: \"kubernetes.io/projected/9c08e959-7140-4322-bb8e-47c231c0af19-kube-api-access-d8w64\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.564765 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-default-certificate\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.564765 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.564950 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564768 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpbwt\" (UniqueName: \"kubernetes.io/projected/47163887-c99e-4309-8e83-491f91e95eae-kube-api-access-vpbwt\") pod \"network-check-source-dbd9cf844-lkgzv\" (UID: \"47163887-c99e-4309-8e83-491f91e95eae\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" Jun 08 22:01:39.564950 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.564833 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.565028 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.564960 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:39.565028 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.564961 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.064941238 +0000 UTC m=+240.187991044 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:39.565028 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.565026 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.065010221 +0000 UTC m=+240.188060014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : secret "router-metrics-certs-default" not found Jun 08 22:01:39.567117 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.567097 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-default-certificate\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.567204 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.567131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-stats-auth\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.572782 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.572765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpbwt\" (UniqueName: \"kubernetes.io/projected/47163887-c99e-4309-8e83-491f91e95eae-kube-api-access-vpbwt\") pod \"network-check-source-dbd9cf844-lkgzv\" (UID: \"47163887-c99e-4309-8e83-491f91e95eae\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" Jun 08 22:01:39.573045 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.573031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8w64\" (UniqueName: \"kubernetes.io/projected/9c08e959-7140-4322-bb8e-47c231c0af19-kube-api-access-d8w64\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:39.611488 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.611464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" Jun 08 22:01:39.635528 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.635504 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" Jun 08 22:01:39.636753 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.636731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:39.725372 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.725342 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:39.746982 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.746960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j"] Jun 08 22:01:39.749570 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:01:39.749544 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9e1433_0a40_4d8a_995c_8864fbc45b05.slice/crio-f7f4aa878e75aad71f8f1dbdedcc424dd50fd7ead148187474fe529f67909a4d WatchSource:0}: Error finding container f7f4aa878e75aad71f8f1dbdedcc424dd50fd7ead148187474fe529f67909a4d: Status 404 returned error can't find the container with id f7f4aa878e75aad71f8f1dbdedcc424dd50fd7ead148187474fe529f67909a4d Jun 08 22:01:39.770598 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.770572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv"] Jun 08 22:01:39.773004 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:01:39.772975 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47163887_c99e_4309_8e83_491f91e95eae.slice/crio-434b6c22ce93ed45600c04908692d3dc844c0561f491ca7054d1e71e882c997b WatchSource:0}: Error finding container 434b6c22ce93ed45600c04908692d3dc844c0561f491ca7054d1e71e882c997b: Status 404 returned error can't find the container with id 434b6c22ce93ed45600c04908692d3dc844c0561f491ca7054d1e71e882c997b Jun 08 22:01:39.867795 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:39.867765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:39.867937 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.867916 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:01:39.867937 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.867928 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9ccc994-tzg9q: secret "image-registry-tls" not found Jun 08 22:01:39.868021 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:39.867976 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls podName:1d82a344-5852-45d4-9bfe-07dea76615c0 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:40.867963165 +0000 UTC m=+240.991012954 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls") pod "image-registry-77b9ccc994-tzg9q" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0") : secret "image-registry-tls" not found Jun 08 22:01:40.069116 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.069023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:40.069116 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.069087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:40.069323 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.069167 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:40.069323 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.069219 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:41.069204075 +0000 UTC m=+241.192253863 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:40.069323 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.069236 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:41.069228697 +0000 UTC m=+241.192278485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : secret "router-metrics-certs-default" not found Jun 08 22:01:40.133897 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.133838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" event={"ID":"47163887-c99e-4309-8e83-491f91e95eae","Type":"ContainerStarted","Data":"c6ea591c47b44c9d68d7bf1e0bb123161604c8e623ce99df7d96a816a9c532cc"} Jun 08 22:01:40.134118 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.134097 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" event={"ID":"47163887-c99e-4309-8e83-491f91e95eae","Type":"ContainerStarted","Data":"434b6c22ce93ed45600c04908692d3dc844c0561f491ca7054d1e71e882c997b"} Jun 08 22:01:40.135008 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.134982 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" event={"ID":"de9e1433-0a40-4d8a-995c-8864fbc45b05","Type":"ContainerStarted","Data":"f7f4aa878e75aad71f8f1dbdedcc424dd50fd7ead148187474fe529f67909a4d"} Jun 08 22:01:40.151072 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.151003 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-lkgzv" podStartSLOduration=1.150989019 podStartE2EDuration="1.150989019s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:40.149822308 +0000 UTC m=+240.272872117" watchObservedRunningTime="2026-06-08 22:01:40.150989019 +0000 UTC m=+240.274038832" Jun 08 22:01:40.876526 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:40.876489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:40.876955 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.876657 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:01:40.876955 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.876676 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9ccc994-tzg9q: secret "image-registry-tls" not found Jun 08 22:01:40.876955 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:40.876742 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls podName:1d82a344-5852-45d4-9bfe-07dea76615c0 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:42.876724701 +0000 UTC m=+242.999774491 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls") pod "image-registry-77b9ccc994-tzg9q" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0") : secret "image-registry-tls" not found Jun 08 22:01:41.078011 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:41.077970 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:41.078180 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:41.078067 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:41.078241 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:41.078194 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:43.078169055 +0000 UTC m=+243.201218846 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:41.078241 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:41.078224 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:41.078354 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:41.078291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:43.078276941 +0000 UTC m=+243.201326733 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : secret "router-metrics-certs-default" not found Jun 08 22:01:42.142827 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.142790 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" event={"ID":"de9e1433-0a40-4d8a-995c-8864fbc45b05","Type":"ContainerStarted","Data":"439a4735ed1fb5c8e3446512587b8157aed7160b1137aecdaba9dd53edd27180"} Jun 08 22:01:42.156981 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.156931 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" podStartSLOduration=1.346377267 podStartE2EDuration="3.156916251s" totalImagesPullingTime="1.810538984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:42.156306036 +0000 UTC m=+242.279355851" watchObservedRunningTime="2026-06-08 22:01:42.156916251 +0000 UTC m=+242.279966058" Jun 08 22:01:42.782826 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.782788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:42.883495 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.883469 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:42.894153 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.894125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:42.894244 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:42.894237 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:01:42.894277 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:42.894248 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9ccc994-tzg9q: secret "image-registry-tls" not found Jun 08 22:01:42.894310 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:42.894303 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls podName:1d82a344-5852-45d4-9bfe-07dea76615c0 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:46.894291031 +0000 UTC m=+247.017340819 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls") pod "image-registry-77b9ccc994-tzg9q" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0") : secret "image-registry-tls" not found Jun 08 22:01:42.983967 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:42.983934 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:43.095984 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.095895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:43.095984 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.095972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:43.096168 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:43.096037 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:43.096168 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:43.096086 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:47.096073204 +0000 UTC m=+247.219122991 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:43.096168 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:43.096107 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:47.096093181 +0000 UTC m=+247.219142969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : secret "router-metrics-certs-default" not found Jun 08 22:01:43.209656 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.209611 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:43.260560 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.260532 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:43.657480 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.657432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:43.757520 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:43.757491 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:45.300294 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:45.300264 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:45.355676 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:45.355653 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:45.373384 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:45.373364 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7flpz_03411705-2d29-4134-9ede-ade8a24b8d87/dns-node-resolver/0.log" Jun 08 22:01:46.375685 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:46.375648 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:46.472476 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:46.472440 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:46.572773 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:46.572748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:46.773819 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:46.773796 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2wvd_354705d3-adde-4fdb-b29f-59477933fca3/node-ca/0.log" Jun 08 22:01:46.926094 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:46.926050 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:46.926259 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:46.926196 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 08 22:01:46.926259 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:46.926215 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77b9ccc994-tzg9q: secret "image-registry-tls" not found Jun 08 22:01:46.926327 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:46.926271 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls podName:1d82a344-5852-45d4-9bfe-07dea76615c0 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:54.926255756 +0000 UTC m=+255.049305544 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls") pod "image-registry-77b9ccc994-tzg9q" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0") : secret "image-registry-tls" not found Jun 08 22:01:47.127635 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:47.127538 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:47.127635 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:47.127620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:47.127826 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:47.127692 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 08 22:01:47.127826 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:47.127745 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:55.127729284 +0000 UTC m=+255.250779074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:47.127826 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:47.127761 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:01:55.127754451 +0000 UTC m=+255.250804240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : secret "router-metrics-certs-default" not found Jun 08 22:01:47.174327 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:47.174305 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-22jqd_74a2419c-b62a-490b-83f5-299136bde102/serve-healthcheck-canary/0.log" Jun 08 22:01:49.005590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.005563 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:49.390704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.390636 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:49.492464 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.492436 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:49.600379 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.600353 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:49.694771 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.694742 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:49.792016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:49.791990 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:50.585054 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:50.585022 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:51.155354 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:51.155321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:01:51.155539 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:51.155473 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 22:01:51.155539 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:51.155537 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs podName:d73578f6-4d06-4dbb-863d-71ea6ebf4df9 nodeName:}" failed. No retries permitted until 2026-06-08 22:03:53.155522548 +0000 UTC m=+373.278572340 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs") pod "network-metrics-daemon-7fvwx" (UID: "d73578f6-4d06-4dbb-863d-71ea6ebf4df9") : secret "metrics-daemon-secret" not found Jun 08 22:01:51.178825 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:51.178797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:51.373509 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:51.373480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:51.775913 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:51.775856 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:51.981786 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:51.981746 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:52.375953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:52.375918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:52.901881 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:52.901829 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.040579 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.040543 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.179490 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.179417 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.379005 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.378972 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.768035 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.768006 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.832402 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.832370 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:53.983974 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:53.983942 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:54.383037 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:54.382997 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:54.985790 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:54.985758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:54.988250 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:54.988223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"image-registry-77b9ccc994-tzg9q\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:55.105806 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.105784 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fkww8\"" Jun 08 22:01:55.113745 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.113728 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:55.178597 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.178571 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:55.187470 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.187444 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:55.187606 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.187504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:55.187720 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:01:55.187704 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle podName:9c08e959-7140-4322-bb8e-47c231c0af19 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:11.187686922 +0000 UTC m=+271.310736709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle") pod "router-default-69667599d7-c7qmw" (UID: "9c08e959-7140-4322-bb8e-47c231c0af19") : configmap references non-existent config key: service-ca.crt Jun 08 22:01:55.190011 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.189988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9c08e959-7140-4322-bb8e-47c231c0af19-metrics-certs\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:01:55.237674 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.237654 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:01:55.239911 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:01:55.239886 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d82a344_5852_45d4_9bfe_07dea76615c0.slice/crio-9eb3f8cf93faa0eb372211dfa844c6ca2b0d34e4248a901308fab183b4634faa WatchSource:0}: Error finding container 9eb3f8cf93faa0eb372211dfa844c6ca2b0d34e4248a901308fab183b4634faa: Status 404 returned error can't find the container with id 9eb3f8cf93faa0eb372211dfa844c6ca2b0d34e4248a901308fab183b4634faa Jun 08 22:01:55.380550 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.380522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:55.528020 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.527943 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:55.630480 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.630059 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:55.976457 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:55.976423 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:56.183477 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.183443 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" event={"ID":"1d82a344-5852-45d4-9bfe-07dea76615c0","Type":"ContainerStarted","Data":"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a"} Jun 08 22:01:56.183889 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.183495 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" event={"ID":"1d82a344-5852-45d4-9bfe-07dea76615c0","Type":"ContainerStarted","Data":"9eb3f8cf93faa0eb372211dfa844c6ca2b0d34e4248a901308fab183b4634faa"} Jun 08 22:01:56.183889 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.183559 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:01:56.202081 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.202031 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" podStartSLOduration=17.202011349 podStartE2EDuration="17.202011349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:01:56.201552355 +0000 UTC m=+256.324602166" watchObservedRunningTime="2026-06-08 22:01:56.202011349 +0000 UTC m=+256.325061159" Jun 08 22:01:56.273840 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.273736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:56.575614 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.575526 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:56.977436 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:56.977411 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:57.381221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:57.381106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:57.436249 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:57.436219 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:57.489682 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:57.489651 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:57.594074 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:57.594040 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:58.175384 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:58.175330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:58.576375 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:58.576320 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:58.989422 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:58.989391 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:59.381324 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:59.381248 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:59.580137 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:59.580106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:01:59.777660 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:01:59.777627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:02.970510 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:02.970475 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.086008 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.085968 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.273170 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.273082 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.637841 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.637756 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.696844 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.696816 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.842923 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.842889 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:03.897144 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:03.897076 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:04.182628 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:04.182557 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:04.850918 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:04.850888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:04.910008 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:04.909978 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:04.980730 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:04.980701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:05.076510 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:05.076481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:06.961916 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:06.961833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:07.863491 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.863463 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-hmjvp"] Jun 08 22:02:07.868004 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.867980 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fjgcj"] Jun 08 22:02:07.868132 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.868095 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:07.870766 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.870739 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cgwlm\"" Jun 08 22:02:07.871480 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.871454 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:07.873705 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.871831 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 22:02:07.873705 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.872643 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 22:02:07.875502 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.875484 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 22:02:07.875639 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.875554 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nlrrx\"" Jun 08 22:02:07.875764 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.875692 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 22:02:07.875832 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.875813 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 22:02:07.876385 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.876365 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:02:07.876542 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.876527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 22:02:07.881728 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.881708 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hmjvp"] Jun 08 22:02:07.888094 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.888073 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fjgcj"] Jun 08 22:02:07.962583 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.962539 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:07.985205 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-data-volume\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:07.985349 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:07.985349 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985235 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-crio-socket\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:07.985349 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjk7h\" (UniqueName: \"kubernetes.io/projected/acb3dab4-e66c-4d22-9f59-b4ce712c6c4e-kube-api-access-xjk7h\") pod \"downloads-6657875f97-hmjvp\" (UID: \"acb3dab4-e66c-4d22-9f59-b4ce712c6c4e\") " pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:07.985469 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985370 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:07.985469 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:07.985404 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xd7x\" (UniqueName: \"kubernetes.io/projected/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-api-access-2xd7x\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.059054 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.059028 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:08.085930 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.085898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.085930 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.085931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-crio-socket\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086068 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.085947 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjk7h\" (UniqueName: \"kubernetes.io/projected/acb3dab4-e66c-4d22-9f59-b4ce712c6c4e-kube-api-access-xjk7h\") pod \"downloads-6657875f97-hmjvp\" (UID: \"acb3dab4-e66c-4d22-9f59-b4ce712c6c4e\") " pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:08.086068 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086016 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-crio-socket\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086068 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086173 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xd7x\" (UniqueName: \"kubernetes.io/projected/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-api-access-2xd7x\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086278 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086255 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-data-volume\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086547 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.086614 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.086544 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-data-volume\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.088622 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.088606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.096212 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.096182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjk7h\" (UniqueName: \"kubernetes.io/projected/acb3dab4-e66c-4d22-9f59-b4ce712c6c4e-kube-api-access-xjk7h\") pod \"downloads-6657875f97-hmjvp\" (UID: \"acb3dab4-e66c-4d22-9f59-b4ce712c6c4e\") " pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:08.096391 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.096370 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xd7x\" (UniqueName: \"kubernetes.io/projected/8e6226e8-b8fd-4b51-93b3-b848fbb3325a-kube-api-access-2xd7x\") pod \"insights-runtime-extractor-fjgcj\" (UID: \"8e6226e8-b8fd-4b51-93b3-b848fbb3325a\") " pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.183185 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.183101 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:08.189463 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.189442 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fjgcj" Jun 08 22:02:08.335398 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.335366 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-hmjvp"] Jun 08 22:02:08.339382 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:08.339352 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb3dab4_e66c_4d22_9f59_b4ce712c6c4e.slice/crio-9fb12d645a83e431782f23b1989adc4f73c89258a4152e663c451ef590f1dd17 WatchSource:0}: Error finding container 9fb12d645a83e431782f23b1989adc4f73c89258a4152e663c451ef590f1dd17: Status 404 returned error can't find the container with id 9fb12d645a83e431782f23b1989adc4f73c89258a4152e663c451ef590f1dd17 Jun 08 22:02:08.353374 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:08.353353 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fjgcj"] Jun 08 22:02:08.358283 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:08.358249 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e6226e8_b8fd_4b51_93b3_b848fbb3325a.slice/crio-82041bb54aef39f47b4212f1ca21c85969c463d364250d8df3bc26ef818b6490 WatchSource:0}: Error finding container 82041bb54aef39f47b4212f1ca21c85969c463d364250d8df3bc26ef818b6490: Status 404 returned error can't find the container with id 82041bb54aef39f47b4212f1ca21c85969c463d364250d8df3bc26ef818b6490 Jun 08 22:02:09.225733 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:09.225689 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjgcj" event={"ID":"8e6226e8-b8fd-4b51-93b3-b848fbb3325a","Type":"ContainerStarted","Data":"b781f25a73ef49ba302174764ee256d3b26f25979028af93096e8886226f8c07"} Jun 08 22:02:09.226237 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:09.225756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjgcj" event={"ID":"8e6226e8-b8fd-4b51-93b3-b848fbb3325a","Type":"ContainerStarted","Data":"4fb0359ccbbb042043b289444df91d2fdc36d1537f944d456e8e99703a202d50"} Jun 08 22:02:09.226237 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:09.225783 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjgcj" event={"ID":"8e6226e8-b8fd-4b51-93b3-b848fbb3325a","Type":"ContainerStarted","Data":"82041bb54aef39f47b4212f1ca21c85969c463d364250d8df3bc26ef818b6490"} Jun 08 22:02:09.227078 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:09.227002 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hmjvp" event={"ID":"acb3dab4-e66c-4d22-9f59-b4ce712c6c4e","Type":"ContainerStarted","Data":"9fb12d645a83e431782f23b1989adc4f73c89258a4152e663c451ef590f1dd17"} Jun 08 22:02:11.210402 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.210342 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:11.211135 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.211107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c08e959-7140-4322-bb8e-47c231c0af19-service-ca-bundle\") pod \"router-default-69667599d7-c7qmw\" (UID: \"9c08e959-7140-4322-bb8e-47c231c0af19\") " pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:11.239156 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.239112 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fjgcj" event={"ID":"8e6226e8-b8fd-4b51-93b3-b848fbb3325a","Type":"ContainerStarted","Data":"7906c8c280c09bbf304fd3f04bfddd368990482abd34a6c5257166397c816827"} Jun 08 22:02:11.259209 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.259159 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fjgcj" podStartSLOduration=2.234305887 podStartE2EDuration="4.259144772s" totalImagesPullingTime="2.024838885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:02:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:11.258350713 +0000 UTC m=+271.381400523" watchObservedRunningTime="2026-06-08 22:02:11.259144772 +0000 UTC m=+271.382194561" Jun 08 22:02:11.433593 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.433565 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vbdxs\"" Jun 08 22:02:11.442250 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.442224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:11.585995 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:11.585963 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-69667599d7-c7qmw"] Jun 08 22:02:11.589189 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:11.589161 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c08e959_7140_4322_bb8e_47c231c0af19.slice/crio-811a08149d4247a59534f181958beb6672192e8ef63825896dafd574d642b9f4 WatchSource:0}: Error finding container 811a08149d4247a59534f181958beb6672192e8ef63825896dafd574d642b9f4: Status 404 returned error can't find the container with id 811a08149d4247a59534f181958beb6672192e8ef63825896dafd574d642b9f4 Jun 08 22:02:12.244347 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.244299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69667599d7-c7qmw" event={"ID":"9c08e959-7140-4322-bb8e-47c231c0af19","Type":"ContainerStarted","Data":"9fc85d1453506fdbb28d25b2558b7514f15badac3298b21e13e19fd46ec7c1f3"} Jun 08 22:02:12.244744 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.244369 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-69667599d7-c7qmw" event={"ID":"9c08e959-7140-4322-bb8e-47c231c0af19","Type":"ContainerStarted","Data":"811a08149d4247a59534f181958beb6672192e8ef63825896dafd574d642b9f4"} Jun 08 22:02:12.264923 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.264877 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-69667599d7-c7qmw" podStartSLOduration=33.26484299 podStartE2EDuration="33.26484299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:01:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:12.263586361 +0000 UTC m=+272.386636174" watchObservedRunningTime="2026-06-08 22:02:12.26484299 +0000 UTC m=+272.387892801" Jun 08 22:02:12.443247 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.443211 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:12.446171 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.446147 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:12.938398 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:12.938353 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.004809 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.004777 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.087784 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.087710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.198236 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.198207 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.247810 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.247759 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:13.249098 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.249078 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-69667599d7-c7qmw" Jun 08 22:02:13.665781 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.665674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.766533 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.766501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.830463 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.830426 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5"] Jun 08 22:02:13.833632 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.833607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:13.835753 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.835730 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 22:02:13.835986 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.835970 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-llmld\"" Jun 08 22:02:13.841818 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.841757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5"] Jun 08 22:02:13.853813 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.853781 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:13.928198 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:13.928106 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79971a79-4fa8-4ff9-ae06-6408b18b1979-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lfpk5\" (UID: \"79971a79-4fa8-4ff9-ae06-6408b18b1979\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:14.028828 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:14.028792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79971a79-4fa8-4ff9-ae06-6408b18b1979-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lfpk5\" (UID: \"79971a79-4fa8-4ff9-ae06-6408b18b1979\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:14.031594 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:14.031568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/79971a79-4fa8-4ff9-ae06-6408b18b1979-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-lfpk5\" (UID: \"79971a79-4fa8-4ff9-ae06-6408b18b1979\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:14.042805 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:14.042780 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:14.144687 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:14.144660 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:14.292598 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:14.292577 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5"] Jun 08 22:02:14.295424 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:14.295393 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79971a79_4fa8_4ff9_ae06_6408b18b1979.slice/crio-9969ccc3be0344abd67f47441ff1954ed0c324f6f2dde76127b9be74e5abc272 WatchSource:0}: Error finding container 9969ccc3be0344abd67f47441ff1954ed0c324f6f2dde76127b9be74e5abc272: Status 404 returned error can't find the container with id 9969ccc3be0344abd67f47441ff1954ed0c324f6f2dde76127b9be74e5abc272 Jun 08 22:02:15.207845 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.207818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:15.257179 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.257143 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" event={"ID":"79971a79-4fa8-4ff9-ae06-6408b18b1979","Type":"ContainerStarted","Data":"9969ccc3be0344abd67f47441ff1954ed0c324f6f2dde76127b9be74e5abc272"} Jun 08 22:02:15.697264 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.697234 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:02:15.700462 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.700443 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.705225 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705097 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 08 22:02:15.705225 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705106 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 08 22:02:15.705415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705296 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 08 22:02:15.705415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705320 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 08 22:02:15.705521 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705422 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 08 22:02:15.705521 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.705459 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4wmn8\"" Jun 08 22:02:15.712101 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.712080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 08 22:02:15.720574 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.720502 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:15.721517 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.721498 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:02:15.739611 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739758 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739758 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739676 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739758 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739711 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739758 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739941 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739796 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9wpw\" (UniqueName: \"kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.739941 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.739824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.798772 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.798732 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:15.841036 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841001 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841221 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9wpw\" (UniqueName: \"kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841492 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841235 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841908 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.841908 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.841895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.842146 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.842106 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.842697 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.842674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.844173 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.844138 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.844398 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.844377 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:15.853102 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:15.853078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9wpw\" (UniqueName: \"kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw\") pod \"console-7bc4d7886b-cq2zv\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:16.012200 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.012113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:16.167494 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.167458 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:02:16.170575 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:16.170550 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6adda4_b9a1_4abd_ad21_da36e3b0d667.slice/crio-b19d241c181f35af8b6b0c886621793fc7c63df5ab3e02db783229d53e87732d WatchSource:0}: Error finding container b19d241c181f35af8b6b0c886621793fc7c63df5ab3e02db783229d53e87732d: Status 404 returned error can't find the container with id b19d241c181f35af8b6b0c886621793fc7c63df5ab3e02db783229d53e87732d Jun 08 22:02:16.262725 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.262634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" event={"ID":"79971a79-4fa8-4ff9-ae06-6408b18b1979","Type":"ContainerStarted","Data":"9b5032937855b9f97f9de9d01307f0f01304e19e48b3515b9a79a3524d483e60"} Jun 08 22:02:16.262913 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.262794 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:16.263888 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.263841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc4d7886b-cq2zv" event={"ID":"aa6adda4-b9a1-4abd-ad21-da36e3b0d667","Type":"ContainerStarted","Data":"b19d241c181f35af8b6b0c886621793fc7c63df5ab3e02db783229d53e87732d"} Jun 08 22:02:16.268317 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.268289 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" Jun 08 22:02:16.318985 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.318927 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-lfpk5" podStartSLOduration=2.423580841 podStartE2EDuration="3.318908575s" totalImagesPullingTime="895.327734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:16.292494517 +0000 UTC m=+276.415544328" watchObservedRunningTime="2026-06-08 22:02:16.318908575 +0000 UTC m=+276.441958385" Jun 08 22:02:16.877067 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.877027 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:16.908036 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.908001 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c"] Jun 08 22:02:16.911314 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.911292 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:16.915905 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.915881 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 22:02:16.916210 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.916189 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 22:02:16.916302 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.916191 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 22:02:16.916302 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.916192 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 22:02:16.916703 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.916686 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rtm9n\"" Jun 08 22:02:16.916790 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.916774 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 22:02:16.924672 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.924642 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c"] Jun 08 22:02:16.951408 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.951380 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:16.951550 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.951421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:16.951550 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.951454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwd9x\" (UniqueName: \"kubernetes.io/projected/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-kube-api-access-fwd9x\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:16.951657 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.951601 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:16.956727 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:16.956701 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:17.053024 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.052989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.053287 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.053079 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.053287 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.053113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.053287 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.053163 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwd9x\" (UniqueName: \"kubernetes.io/projected/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-kube-api-access-fwd9x\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.054271 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.054242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.056691 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.056658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.056691 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.056674 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.065846 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.065819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwd9x\" (UniqueName: \"kubernetes.io/projected/ff1f7118-cda3-4725-afc2-1163ab0f3d0c-kube-api-access-fwd9x\") pod \"prometheus-operator-7f7d445d84-v9h7c\" (UID: \"ff1f7118-cda3-4725-afc2-1163ab0f3d0c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.094595 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.094523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:17.222705 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.222574 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" Jun 08 22:02:17.387256 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.387218 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c"] Jun 08 22:02:17.389261 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:17.389224 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff1f7118_cda3_4725_afc2_1163ab0f3d0c.slice/crio-cdfa1a6666a55ece0c98196e02e7eea564ec806e86a84c4bebe463e6a47f3d7c WatchSource:0}: Error finding container cdfa1a6666a55ece0c98196e02e7eea564ec806e86a84c4bebe463e6a47f3d7c: Status 404 returned error can't find the container with id cdfa1a6666a55ece0c98196e02e7eea564ec806e86a84c4bebe463e6a47f3d7c Jun 08 22:02:17.883418 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.883378 2562 patch_prober.go:28] interesting pod/image-registry-77b9ccc994-tzg9q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 22:02:17.883894 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:17.883440 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 22:02:18.273318 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:18.273281 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" event={"ID":"ff1f7118-cda3-4725-afc2-1163ab0f3d0c","Type":"ContainerStarted","Data":"cdfa1a6666a55ece0c98196e02e7eea564ec806e86a84c4bebe463e6a47f3d7c"} Jun 08 22:02:22.911618 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:22.911569 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-rjc5n" podUID="c95acc29-4ad3-45dd-a646-2c439bd0a6e9" Jun 08 22:02:23.291527 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:23.291499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:23.883780 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:23.883736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:23.940919 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:23.940883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:26.204992 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.204963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:26.232386 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.232343 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:26.235174 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.235142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c95acc29-4ad3-45dd-a646-2c439bd0a6e9-metrics-tls\") pod \"dns-default-rjc5n\" (UID: \"c95acc29-4ad3-45dd-a646-2c439bd0a6e9\") " pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:26.294969 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.294938 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-fmxnl\"" Jun 08 22:02:26.303041 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.303010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:26.305679 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.305080 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-hmjvp" event={"ID":"acb3dab4-e66c-4d22-9f59-b4ce712c6c4e","Type":"ContainerStarted","Data":"b08406d33e857ec681cf888a9a5f1b986d84ef50906f7b1c87f64a7f358ba2e3"} Jun 08 22:02:26.305679 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.305440 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:26.307969 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.307917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc4d7886b-cq2zv" event={"ID":"aa6adda4-b9a1-4abd-ad21-da36e3b0d667","Type":"ContainerStarted","Data":"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896"} Jun 08 22:02:26.309931 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.309910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" event={"ID":"ff1f7118-cda3-4725-afc2-1163ab0f3d0c","Type":"ContainerStarted","Data":"83611d424682a115e058cee74c7b63bb833bcc1e5857caf290b3976ba264149d"} Jun 08 22:02:26.310018 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.309952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" event={"ID":"ff1f7118-cda3-4725-afc2-1163ab0f3d0c","Type":"ContainerStarted","Data":"eac307afbdea051d9777ee97a593eada62e8c3ca43e3aa9edf3ae0ae30e3b248"} Jun 08 22:02:26.318917 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.318897 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-hmjvp" Jun 08 22:02:26.322001 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.321444 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-hmjvp" podStartSLOduration=1.802552365 podStartE2EDuration="19.321427718s" totalImagesPullingTime="17.518875353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:26.320536258 +0000 UTC m=+286.443586071" watchObservedRunningTime="2026-06-08 22:02:26.321427718 +0000 UTC m=+286.444477529" Jun 08 22:02:26.357896 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.357200 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bc4d7886b-cq2zv" podStartSLOduration=1.663608027 podStartE2EDuration="11.357180889s" totalImagesPullingTime="9.693572862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:26.356605696 +0000 UTC m=+286.479655506" watchObservedRunningTime="2026-06-08 22:02:26.357180889 +0000 UTC m=+286.480230694" Jun 08 22:02:26.374305 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.374239 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v9h7c" podStartSLOduration=1.858394 podStartE2EDuration="10.374220515s" totalImagesPullingTime="8.515826515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:26.371815155 +0000 UTC m=+286.494864965" watchObservedRunningTime="2026-06-08 22:02:26.374220515 +0000 UTC m=+286.497270327" Jun 08 22:02:26.468854 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:26.468773 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-rjc5n"] Jun 08 22:02:26.471913 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:26.471859 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc95acc29_4ad3_45dd_a646_2c439bd0a6e9.slice/crio-a0325c0e92b8cffbf33b9989aaff48ebcda61d9fa3903b622f70958b0d8ac38f WatchSource:0}: Error finding container a0325c0e92b8cffbf33b9989aaff48ebcda61d9fa3903b622f70958b0d8ac38f: Status 404 returned error can't find the container with id a0325c0e92b8cffbf33b9989aaff48ebcda61d9fa3903b622f70958b0d8ac38f Jun 08 22:02:27.317606 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.317527 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjc5n" event={"ID":"c95acc29-4ad3-45dd-a646-2c439bd0a6e9","Type":"ContainerStarted","Data":"a0325c0e92b8cffbf33b9989aaff48ebcda61d9fa3903b622f70958b0d8ac38f"} Jun 08 22:02:27.414996 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.414957 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:27.517225 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.517195 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:27.575200 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.575117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:27.882898 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.882421 2562 patch_prober.go:28] interesting pod/image-registry-77b9ccc994-tzg9q container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 08 22:02:27.882898 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:27.882484 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 22:02:28.012440 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.012340 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.236884 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.236845 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.258711 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.258673 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm"] Jun 08 22:02:28.272976 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.272949 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.277234 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.276962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sc9vl\"" Jun 08 22:02:28.277234 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.276994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 08 22:02:28.277234 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.277004 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 08 22:02:28.278923 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.278898 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm"] Jun 08 22:02:28.315022 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.314993 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rjslp"] Jun 08 22:02:28.327007 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.326982 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.329249 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.329227 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vkhpx\"" Jun 08 22:02:28.330097 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.330076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 22:02:28.330180 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.330093 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 22:02:28.330434 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.330408 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 22:02:28.331067 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.331047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.351745 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351715 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487f93e-4fd7-4a8e-a6b0-63212d62495f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.351902 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351765 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rwnp\" (UniqueName: \"kubernetes.io/projected/7487f93e-4fd7-4a8e-a6b0-63212d62495f-kube-api-access-7rwnp\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.351902 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-root\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.351902 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351822 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.351902 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-wtmp\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351946 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.351976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-textfile\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.352000 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-metrics-client-ca\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.352045 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.352120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.352076 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352378 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.352148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-sys\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.352378 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.352230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqxgh\" (UniqueName: \"kubernetes.io/projected/ef049d98-30be-435b-890c-f2bfcf30d016-kube-api-access-xqxgh\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.438377 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.438348 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.453678 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487f93e-4fd7-4a8e-a6b0-63212d62495f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.453843 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rwnp\" (UniqueName: \"kubernetes.io/projected/7487f93e-4fd7-4a8e-a6b0-63212d62495f-kube-api-access-7rwnp\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.453843 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453728 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-root\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.453843 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.453843 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.453843 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-wtmp\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454145 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453849 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-root\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454145 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.453979 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-wtmp\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454145 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:28.454075 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 08 22:02:28.454145 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:28.454131 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls podName:ef049d98-30be-435b-890c-f2bfcf30d016 nodeName:}" failed. No retries permitted until 2026-06-08 22:02:28.954112514 +0000 UTC m=+289.077162311 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls") pod "node-exporter-rjslp" (UID: "ef049d98-30be-435b-890c-f2bfcf30d016") : secret "node-exporter-tls" not found Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454186 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-textfile\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454210 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-metrics-client-ca\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-sys\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454399 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454392 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqxgh\" (UniqueName: \"kubernetes.io/projected/ef049d98-30be-435b-890c-f2bfcf30d016-kube-api-access-xqxgh\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454747 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7487f93e-4fd7-4a8e-a6b0-63212d62495f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.454747 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-accelerators-collector-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454747 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef049d98-30be-435b-890c-f2bfcf30d016-sys\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454921 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef049d98-30be-435b-890c-f2bfcf30d016-metrics-client-ca\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.454921 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.454835 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-textfile\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.457374 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.457345 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.457374 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.457366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.457587 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.457565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7487f93e-4fd7-4a8e-a6b0-63212d62495f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.463631 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.463610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqxgh\" (UniqueName: \"kubernetes.io/projected/ef049d98-30be-435b-890c-f2bfcf30d016-kube-api-access-xqxgh\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.463924 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.463898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rwnp\" (UniqueName: \"kubernetes.io/projected/7487f93e-4fd7-4a8e-a6b0-63212d62495f-kube-api-access-7rwnp\") pod \"openshift-state-metrics-65f78d5c66-9jdxm\" (UID: \"7487f93e-4fd7-4a8e-a6b0-63212d62495f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.539070 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.539042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.585727 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.585497 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" Jun 08 22:02:28.640660 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.640617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.741654 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.741604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.788029 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.787960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm"] Jun 08 22:02:28.793946 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:28.793911 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7487f93e_4fd7_4a8e_a6b0_63212d62495f.slice/crio-5ff6bc89d351dc95a1a3444aa2934a53faa7c037c4395fb027530c7c97c0a713 WatchSource:0}: Error finding container 5ff6bc89d351dc95a1a3444aa2934a53faa7c037c4395fb027530c7c97c0a713: Status 404 returned error can't find the container with id 5ff6bc89d351dc95a1a3444aa2934a53faa7c037c4395fb027530c7c97c0a713 Jun 08 22:02:28.842089 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.842059 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.939762 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.939735 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:28.959209 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.959185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:28.961787 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:28.961758 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef049d98-30be-435b-890c-f2bfcf30d016-node-exporter-tls\") pod \"node-exporter-rjslp\" (UID: \"ef049d98-30be-435b-890c-f2bfcf30d016\") " pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:29.238440 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.238400 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rjslp" Jun 08 22:02:29.266952 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.266918 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:29.267912 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:29.267841 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef049d98_30be_435b_890c_f2bfcf30d016.slice/crio-cbb959228c20d972daea8393fcce4d19eabd32f926a525df06b51991d077a269 WatchSource:0}: Error finding container cbb959228c20d972daea8393fcce4d19eabd32f926a525df06b51991d077a269: Status 404 returned error can't find the container with id cbb959228c20d972daea8393fcce4d19eabd32f926a525df06b51991d077a269 Jun 08 22:02:29.328826 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.328759 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjc5n" event={"ID":"c95acc29-4ad3-45dd-a646-2c439bd0a6e9","Type":"ContainerStarted","Data":"f73c3c2820de65b947b70ebf3d94f98e7a1b500a4d219b32c3455aa1fd194e46"} Jun 08 22:02:29.329223 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.328841 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-rjc5n" event={"ID":"c95acc29-4ad3-45dd-a646-2c439bd0a6e9","Type":"ContainerStarted","Data":"ec71636c3ff7f1e48fcd32926cfab9174021e4fa6c427bdcac88a7d89213fcd7"} Jun 08 22:02:29.329223 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.328916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:29.330678 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.330649 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjslp" event={"ID":"ef049d98-30be-435b-890c-f2bfcf30d016","Type":"ContainerStarted","Data":"cbb959228c20d972daea8393fcce4d19eabd32f926a525df06b51991d077a269"} Jun 08 22:02:29.332842 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.332818 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" event={"ID":"7487f93e-4fd7-4a8e-a6b0-63212d62495f","Type":"ContainerStarted","Data":"1a2c8ab166ad909494f19f910cc782a2250f7dbcbdaf2c26e398e3696131bc22"} Jun 08 22:02:29.332973 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.332886 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" event={"ID":"7487f93e-4fd7-4a8e-a6b0-63212d62495f","Type":"ContainerStarted","Data":"72f157995bcd052c642ce73c6fe345f662fcd218477ec6a72e6a9f5058df7e11"} Jun 08 22:02:29.332973 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.332917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" event={"ID":"7487f93e-4fd7-4a8e-a6b0-63212d62495f","Type":"ContainerStarted","Data":"5ff6bc89d351dc95a1a3444aa2934a53faa7c037c4395fb027530c7c97c0a713"} Jun 08 22:02:29.349699 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.349655 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-rjc5n" podStartSLOduration=251.29350358 podStartE2EDuration="4m13.349641852s" totalImagesPullingTime="2.056138272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:58:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:29.348332397 +0000 UTC m=+289.471382206" watchObservedRunningTime="2026-06-08 22:02:29.349641852 +0000 UTC m=+289.472691665" Jun 08 22:02:29.368937 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.368915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:29.636601 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:29.636473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:31.290022 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.289987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:31.350821 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.350792 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:31.350971 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.350891 2562 generic.go:356] "Generic (PLEG): container finished" podID="4d4ba163-3749-4b81-860d-43ccad37329f" containerID="e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1" exitCode=1 Jun 08 22:02:31.351038 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.350987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerDied","Data":"e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1"} Jun 08 22:02:31.351095 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.351051 2562 scope.go:117] "RemoveContainer" containerID="4e381e36d4c3a03d97b15f3ff0ef7417056a277af04e0db4fd50f55a71e7a20b" Jun 08 22:02:31.351409 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.351392 2562 scope.go:117] "RemoveContainer" containerID="e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1" Jun 08 22:02:31.351635 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:31.351610 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn_open-cluster-management-agent-addon(4d4ba163-3749-4b81-860d-43ccad37329f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" podUID="4d4ba163-3749-4b81-860d-43ccad37329f" Jun 08 22:02:31.353284 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.353259 2562 generic.go:356] "Generic (PLEG): container finished" podID="ef049d98-30be-435b-890c-f2bfcf30d016" containerID="770a1820e47e10097623c42cce2143e043c7419d9f31d12416d82c1d40a62520" exitCode=0 Jun 08 22:02:31.353375 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.353346 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjslp" event={"ID":"ef049d98-30be-435b-890c-f2bfcf30d016","Type":"ContainerDied","Data":"770a1820e47e10097623c42cce2143e043c7419d9f31d12416d82c1d40a62520"} Jun 08 22:02:31.355671 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.355647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" event={"ID":"7487f93e-4fd7-4a8e-a6b0-63212d62495f","Type":"ContainerStarted","Data":"043df9482a3a55b30ca36467dd58eadaf36b8c81f5848b86b6833354f94a6654"} Jun 08 22:02:31.395469 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.395411 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-9jdxm" podStartSLOduration=1.414915271 podStartE2EDuration="3.39539045s" totalImagesPullingTime="1.980475179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:31.394076767 +0000 UTC m=+291.517126591" watchObservedRunningTime="2026-06-08 22:02:31.39539045 +0000 UTC m=+291.518440263" Jun 08 22:02:31.764727 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.764693 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:31.892595 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.892517 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:31.942511 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:31.942477 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:02:32.361890 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:32.361840 2562 scope.go:117] "RemoveContainer" containerID="e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1" Jun 08 22:02:32.362332 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:32.362080 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn_open-cluster-management-agent-addon(4d4ba163-3749-4b81-860d-43ccad37329f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" podUID="4d4ba163-3749-4b81-860d-43ccad37329f" Jun 08 22:02:32.364283 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:32.364249 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjslp" event={"ID":"ef049d98-30be-435b-890c-f2bfcf30d016","Type":"ContainerStarted","Data":"aff69719e9155db4704a739880fe8e942849693d9e0e402d27ed2f68ab27ae5d"} Jun 08 22:02:32.364412 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:32.364308 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rjslp" event={"ID":"ef049d98-30be-435b-890c-f2bfcf30d016","Type":"ContainerStarted","Data":"1f9610ee6e445f1122d2b900f7721a00d4c5686488fa91e01a797e8523c0ddae"} Jun 08 22:02:32.403722 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:32.403669 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rjslp" podStartSLOduration=2.532789133 podStartE2EDuration="4.40365013s" totalImagesPullingTime="1.76243666s" totalInitContainerRuntime="108.424337ms" isStatefulPod=true podCreationTimestamp="2026-06-08 22:02:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:32.402005143 +0000 UTC m=+292.525054965" watchObservedRunningTime="2026-06-08 22:02:32.40365013 +0000 UTC m=+292.526699941" Jun 08 22:02:32.900216 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:32.900167 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" containerID="cri-o://63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a" gracePeriod=30 Jun 08 22:02:33.196071 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.196037 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:02:33.211743 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.211705 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:33.246242 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.246215 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:02:33.246612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.246587 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" Jun 08 22:02:33.246612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.246613 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" Jun 08 22:02:33.246767 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.246701 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerName="registry" Jun 08 22:02:33.261886 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.261839 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:02:33.262014 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.261963 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.292501 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.292468 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:33.300301 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300270 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.300419 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300354 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.300419 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300378 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.300419 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300398 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.300584 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300421 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.300836 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300797 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:02:33.300836 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300810 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:02:33.301004 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300897 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpn9n\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.301004 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.300939 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.301114 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301005 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted\") pod \"1d82a344-5852-45d4-9bfe-07dea76615c0\" (UID: \"1d82a344-5852-45d4-9bfe-07dea76615c0\") " Jun 08 22:02:33.301318 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301387 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301509 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301580 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301527 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301636 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301622 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301927 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r95c\" (UniqueName: \"kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.301927 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301760 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-trusted-ca\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.301927 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.301782 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-certificates\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.304396 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.304258 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:02:33.304396 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.304359 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n" (OuterVolumeSpecName: "kube-api-access-mpn9n") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "kube-api-access-mpn9n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:02:33.304658 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.304633 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:02:33.305190 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.305160 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:02:33.306646 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.306620 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:02:33.309859 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.309836 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1d82a344-5852-45d4-9bfe-07dea76615c0" (UID: "1d82a344-5852-45d4-9bfe-07dea76615c0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 08 22:02:33.369936 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.369904 2562 generic.go:356] "Generic (PLEG): container finished" podID="1d82a344-5852-45d4-9bfe-07dea76615c0" containerID="63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a" exitCode=0 Jun 08 22:02:33.370337 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.369999 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" Jun 08 22:02:33.370337 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.370030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" event={"ID":"1d82a344-5852-45d4-9bfe-07dea76615c0","Type":"ContainerDied","Data":"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a"} Jun 08 22:02:33.370337 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.370093 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77b9ccc994-tzg9q" event={"ID":"1d82a344-5852-45d4-9bfe-07dea76615c0","Type":"ContainerDied","Data":"9eb3f8cf93faa0eb372211dfa844c6ca2b0d34e4248a901308fab183b4634faa"} Jun 08 22:02:33.370337 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.370125 2562 scope.go:117] "RemoveContainer" containerID="63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a" Jun 08 22:02:33.379724 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.379704 2562 scope.go:117] "RemoveContainer" containerID="63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a" Jun 08 22:02:33.380035 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:33.380013 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a\": container with ID starting with 63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a not found: ID does not exist" containerID="63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a" Jun 08 22:02:33.380118 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.380046 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a"} err="failed to get container status \"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a\": rpc error: code = NotFound desc = could not find container \"63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a\": container with ID starting with 63b63fd9ff61de108f3bf73782595c76d9577c4a865f3ab6fb6a86954ed6680a not found: ID does not exist" Jun 08 22:02:33.393507 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.393480 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:02:33.396054 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.396034 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77b9ccc994-tzg9q"] Jun 08 22:02:33.402824 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.402799 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.402932 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.402854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.402932 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.402914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403038 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.402969 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403038 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.402994 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403136 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r95c\" (UniqueName: \"kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403136 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403238 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403190 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-bound-sa-token\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403238 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403206 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpn9n\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-kube-api-access-mpn9n\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403238 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403220 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d82a344-5852-45d4-9bfe-07dea76615c0-registry-tls\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403238 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403233 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d82a344-5852-45d4-9bfe-07dea76615c0-ca-trust-extracted\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403244 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-installation-pull-secrets\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403258 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d82a344-5852-45d4-9bfe-07dea76615c0-image-registry-private-configuration\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:02:33.403658 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.403796 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.403657 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.404305 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.404242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.404305 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.404245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.406057 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.406030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.406427 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.406407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.411623 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.411562 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r95c\" (UniqueName: \"kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c\") pod \"console-8c457ccb-m7l4z\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.573972 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.573937 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:33.766657 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.766623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:02:33.771117 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:33.771087 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8659ce3f_de46_4948_88c0_c7d070074375.slice/crio-4bd6d2ac2daaeae0d97a8bf8df88b58e738c19979d3c8def00dee0afe2a96464 WatchSource:0}: Error finding container 4bd6d2ac2daaeae0d97a8bf8df88b58e738c19979d3c8def00dee0afe2a96464: Status 404 returned error can't find the container with id 4bd6d2ac2daaeae0d97a8bf8df88b58e738c19979d3c8def00dee0afe2a96464 Jun 08 22:02:33.902299 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:33.902261 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:34.004883 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.004820 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:34.104913 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.104878 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:34.384174 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.384084 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d82a344-5852-45d4-9bfe-07dea76615c0" path="/var/lib/kubelet/pods/1d82a344-5852-45d4-9bfe-07dea76615c0/volumes" Jun 08 22:02:34.387714 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.387677 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c457ccb-m7l4z" event={"ID":"8659ce3f-de46-4948-88c0-c7d070074375","Type":"ContainerStarted","Data":"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5"} Jun 08 22:02:34.387891 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.387736 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c457ccb-m7l4z" event={"ID":"8659ce3f-de46-4948-88c0-c7d070074375","Type":"ContainerStarted","Data":"4bd6d2ac2daaeae0d97a8bf8df88b58e738c19979d3c8def00dee0afe2a96464"} Jun 08 22:02:34.413627 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.413565 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8c457ccb-m7l4z" podStartSLOduration=1.413545992 podStartE2EDuration="1.413545992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:34.411535235 +0000 UTC m=+294.534585047" watchObservedRunningTime="2026-06-08 22:02:34.413545992 +0000 UTC m=+294.536595803" Jun 08 22:02:34.613823 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.613782 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:34.617462 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.617429 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:34.642400 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.642324 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:34.642538 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.642493 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.646859 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.646840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 08 22:02:34.647377 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.647349 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-qftc7\"" Jun 08 22:02:34.647607 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.647587 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 08 22:02:34.647827 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.647807 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 08 22:02:34.648372 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.648342 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9skvl7qv5lial\"" Jun 08 22:02:34.649396 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.649379 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 08 22:02:34.651416 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.650454 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 08 22:02:34.651416 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.650663 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 08 22:02:34.651416 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.650840 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 08 22:02:34.651416 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.650977 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 08 22:02:34.651416 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.651276 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 08 22:02:34.651845 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.651828 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 08 22:02:34.652223 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.652206 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 08 22:02:34.652413 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.652393 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 08 22:02:34.652755 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.652737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 08 22:02:34.653141 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.653122 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 08 22:02:34.653744 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.653681 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 08 22:02:34.714553 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714510 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714738 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714738 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714738 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714663 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714738 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714764 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714904 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.714953 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.714994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715034 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715055 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715125 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715176 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn57f\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-kube-api-access-jn57f\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715529 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715187 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.715529 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.715217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816374 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816374 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816379 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816625 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816404 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816625 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816555 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816625 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816771 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816625 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816771 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816771 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.816771 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816760 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816785 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816814 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816914 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816945 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.816971 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817016 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817365 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817365 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817365 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817081 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn57f\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-kube-api-access-jn57f\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817365 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817107 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.817560 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.817364 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.819948 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.819920 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.820277 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.820253 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.822334 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.820700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.822458 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.820790 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.822561 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.821455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.822654 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.821589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.823312 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.822698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.823809 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.823765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.824712 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.824672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.825236 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.825185 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-web-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.825331 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.825312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/986491b2-b82c-4660-a7e0-6cd0640550dc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.825693 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.825421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.827612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.826639 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.827612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.827530 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.827612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.827561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/986491b2-b82c-4660-a7e0-6cd0640550dc-config-out\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.828426 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.828342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.828884 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.828844 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-config\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.829241 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.829211 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/986491b2-b82c-4660-a7e0-6cd0640550dc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.838467 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.838422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn57f\" (UniqueName: \"kubernetes.io/projected/986491b2-b82c-4660-a7e0-6cd0640550dc-kube-api-access-jn57f\") pod \"prometheus-k8s-0\" (UID: \"986491b2-b82c-4660-a7e0-6cd0640550dc\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:34.960121 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:34.960079 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:35.123612 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.123577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:35.161435 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.161395 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 08 22:02:35.165340 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:02:35.165300 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod986491b2_b82c_4660_a7e0_6cd0640550dc.slice/crio-5a554b769e14670e0e886b2e0205eb547aaf5ec2e123de78081c6170a2941b1f WatchSource:0}: Error finding container 5a554b769e14670e0e886b2e0205eb547aaf5ec2e123de78081c6170a2941b1f: Status 404 returned error can't find the container with id 5a554b769e14670e0e886b2e0205eb547aaf5ec2e123de78081c6170a2941b1f Jun 08 22:02:35.220920 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.220837 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:35.394133 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.394098 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"5a554b769e14670e0e886b2e0205eb547aaf5ec2e123de78081c6170a2941b1f"} Jun 08 22:02:35.889199 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.889165 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:02:35.889604 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:35.889590 2562 scope.go:117] "RemoveContainer" containerID="e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1" Jun 08 22:02:35.889800 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:35.889780 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn_open-cluster-management-agent-addon(4d4ba163-3749-4b81-860d-43ccad37329f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" podUID="4d4ba163-3749-4b81-860d-43ccad37329f" Jun 08 22:02:36.012405 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:36.012378 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:36.012625 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:36.012443 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:02:36.013364 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:36.013339 2562 patch_prober.go:28] interesting pod/console-7bc4d7886b-cq2zv container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" start-of-body= Jun 08 22:02:36.013453 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:36.013385 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bc4d7886b-cq2zv" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerName="console" probeResult="failure" output="Get \"https://10.134.0.16:8443/health\": dial tcp 10.134.0.16:8443: connect: connection refused" Jun 08 22:02:37.402901 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:37.402852 2562 generic.go:356] "Generic (PLEG): container finished" podID="986491b2-b82c-4660-a7e0-6cd0640550dc" containerID="e0b3857c56e025943109b08f2d1be8d98c76c72f15fa3c0b5d8b20918191c5c0" exitCode=0 Jun 08 22:02:37.403441 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:37.402959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerDied","Data":"e0b3857c56e025943109b08f2d1be8d98c76c72f15fa3c0b5d8b20918191c5c0"} Jun 08 22:02:38.371764 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:02:38.371721 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-7fvwx" podUID="d73578f6-4d06-4dbb-863d-71ea6ebf4df9" Jun 08 22:02:39.343490 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:39.343456 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-rjc5n" Jun 08 22:02:40.192570 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:40.192537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:40.251654 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:40.251618 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:40.536705 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:40.536612 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:40.898885 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:40.639833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:41.032566 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.032535 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:41.084415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.084393 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 22:02:41.085191 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.085164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 22:02:41.088637 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.088620 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 22:02:41.092216 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.092196 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:41.699577 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:41.699546 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:02:42.430249 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:42.430210 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"fc613a6fd711726c57223882e414d3b456abb28b2c0118cf8769df2621c284ff"} Jun 08 22:02:42.430488 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:42.430278 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"e0b55989c66dbc4c384d470593a4f313d864995789762778c275fa2db1e9382b"} Jun 08 22:02:43.129166 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:43.129133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:43.230767 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:43.230736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:43.574741 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:43.574714 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:43.574909 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:43.574779 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:43.578944 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:43.578924 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:44.442717 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.442674 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"5559037ba52ea92de17e117c4c0a01090aa049a704a911f8ea2616f464698768"} Jun 08 22:02:44.443190 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.442739 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"5dca6872263ab70c742f4e33fb892566245c20073910c38db6c88d2055b61666"} Jun 08 22:02:44.443190 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.442766 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"dbdfea33f59a5fdf06b1f382d81561100e1c6f6b65f1ba180611447cbe82f192"} Jun 08 22:02:44.443190 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.442800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"986491b2-b82c-4660-a7e0-6cd0640550dc","Type":"ContainerStarted","Data":"b0ba625712ef79294ea9dc2355674a26126f37b24e0eab75cc93c014c4fd51dc"} Jun 08 22:02:44.451220 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.447073 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:02:44.476363 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.476322 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.7734880840000002 podStartE2EDuration="10.476306794s" totalImagesPullingTime="7.683373621s" totalInitContainerRuntime="19.445089ms" isStatefulPod=false podCreationTimestamp="2026-06-08 22:02:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:02:44.475659396 +0000 UTC m=+304.598709216" watchObservedRunningTime="2026-06-08 22:02:44.476306794 +0000 UTC m=+304.599356652" Jun 08 22:02:44.528177 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.528149 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:02:44.645739 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.645708 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:44.746384 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.746310 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:44.846976 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.846948 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:44.960442 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:44.960408 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:02:46.633184 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:46.633150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:46.733925 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:46.733891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:49.369858 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:49.369808 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:49.372061 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:49.372046 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:02:49.372188 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:49.372174 2562 scope.go:117] "RemoveContainer" containerID="e3cf1d0bee57b0e186c2d1c3574c763d2666688f5296b45b013291bb35a4efa1" Jun 08 22:02:49.531297 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:49.531208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:50.014899 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:50.014848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:50.118059 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:50.118020 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:02:50.471779 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:50.471748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" event={"ID":"4d4ba163-3749-4b81-860d-43ccad37329f","Type":"ContainerStarted","Data":"1791e6abd4acffba96ef46fa3fc97cf0ad54af75a603b798f4e2a141f59e8435"} Jun 08 22:02:50.472207 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:50.472105 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:02:50.475079 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:02:50.475050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5dc7b4dc7f-9zzcn" Jun 08 22:03:07.535314 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:07.535224 2562 generic.go:356] "Generic (PLEG): container finished" podID="de9e1433-0a40-4d8a-995c-8864fbc45b05" containerID="439a4735ed1fb5c8e3446512587b8157aed7160b1137aecdaba9dd53edd27180" exitCode=0 Jun 08 22:03:07.535687 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:07.535303 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" event={"ID":"de9e1433-0a40-4d8a-995c-8864fbc45b05","Type":"ContainerDied","Data":"439a4735ed1fb5c8e3446512587b8157aed7160b1137aecdaba9dd53edd27180"} Jun 08 22:03:07.535687 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:07.535610 2562 scope.go:117] "RemoveContainer" containerID="439a4735ed1fb5c8e3446512587b8157aed7160b1137aecdaba9dd53edd27180" Jun 08 22:03:08.540812 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:08.540777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-clp6j" event={"ID":"de9e1433-0a40-4d8a-995c-8864fbc45b05","Type":"ContainerStarted","Data":"f1e44d1ef001583cbf4ab1316f4ccdab52711ae8bbc6d666a5b3a28dd0f01b96"} Jun 08 22:03:09.548322 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.548288 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bc4d7886b-cq2zv" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerName="console" containerID="cri-o://1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896" gracePeriod=15 Jun 08 22:03:09.822524 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.822443 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:03:09.923350 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923317 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923350 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923359 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923378 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923417 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923454 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923473 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923570 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9wpw\" (UniqueName: \"kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw\") pod \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\" (UID: \"aa6adda4-b9a1-4abd-ad21-da36e3b0d667\") " Jun 08 22:03:09.923844 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923777 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca" (OuterVolumeSpecName: "service-ca") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:09.923921 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923896 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:09.923964 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.923916 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config" (OuterVolumeSpecName: "console-config") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:09.924322 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.924293 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:03:09.925723 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.925703 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:09.925788 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.925750 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:03:09.925909 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:09.925893 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw" (OuterVolumeSpecName: "kube-api-access-j9wpw") pod "aa6adda4-b9a1-4abd-ad21-da36e3b0d667" (UID: "aa6adda4-b9a1-4abd-ad21-da36e3b0d667"). InnerVolumeSpecName "kube-api-access-j9wpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:03:10.024288 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024256 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-trusted-ca-bundle\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024288 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024283 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-oauth-serving-cert\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024288 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024292 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9wpw\" (UniqueName: \"kubernetes.io/projected/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-kube-api-access-j9wpw\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024495 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024300 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-serving-cert\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024495 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024309 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-service-ca\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024495 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024318 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-config\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.024495 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.024326 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aa6adda4-b9a1-4abd-ad21-da36e3b0d667-console-oauth-config\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:03:10.549073 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.549041 2562 generic.go:356] "Generic (PLEG): container finished" podID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerID="1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896" exitCode=0 Jun 08 22:03:10.549443 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.549088 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bc4d7886b-cq2zv" Jun 08 22:03:10.549443 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.549107 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc4d7886b-cq2zv" event={"ID":"aa6adda4-b9a1-4abd-ad21-da36e3b0d667","Type":"ContainerDied","Data":"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896"} Jun 08 22:03:10.549443 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.549151 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bc4d7886b-cq2zv" event={"ID":"aa6adda4-b9a1-4abd-ad21-da36e3b0d667","Type":"ContainerDied","Data":"b19d241c181f35af8b6b0c886621793fc7c63df5ab3e02db783229d53e87732d"} Jun 08 22:03:10.549443 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.549169 2562 scope.go:117] "RemoveContainer" containerID="1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896" Jun 08 22:03:10.557664 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.557648 2562 scope.go:117] "RemoveContainer" containerID="1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896" Jun 08 22:03:10.557940 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:03:10.557921 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896\": container with ID starting with 1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896 not found: ID does not exist" containerID="1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896" Jun 08 22:03:10.557995 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.557948 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896"} err="failed to get container status \"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896\": rpc error: code = NotFound desc = could not find container \"1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896\": container with ID starting with 1c41b0ddea97c48df3f1010b48499c9d378e77447218c0c2c5767655f55ed896 not found: ID does not exist" Jun 08 22:03:10.573223 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.569391 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:03:10.575346 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:10.575326 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bc4d7886b-cq2zv"] Jun 08 22:03:12.377033 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:12.376993 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" path="/var/lib/kubelet/pods/aa6adda4-b9a1-4abd-ad21-da36e3b0d667/volumes" Jun 08 22:03:12.419203 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:12.419171 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:12.472794 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:12.472767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:19.294141 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:19.294106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:19.394295 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:19.394256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:19.449120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:19.449086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:31.651256 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:31.651178 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:33.841775 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:33.841745 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:34.960944 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:34.960901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:34.977002 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:34.976978 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:35.656419 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:35.656395 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 08 22:03:47.872153 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:47.872110 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:48.227370 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:48.227332 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:50.414404 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:50.414362 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:50.474702 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:50.474672 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:51.669717 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:51.669683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:53.179013 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.178973 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:03:53.181532 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.181509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d73578f6-4d06-4dbb-863d-71ea6ebf4df9-metrics-certs\") pod \"network-metrics-daemon-7fvwx\" (UID: \"d73578f6-4d06-4dbb-863d-71ea6ebf4df9\") " pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:03:53.235507 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.235481 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:53.275135 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.275109 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wrq9n\"" Jun 08 22:03:53.283078 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.283059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7fvwx" Jun 08 22:03:53.341645 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.341613 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:53.427510 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.427488 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7fvwx"] Jun 08 22:03:53.429942 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:03:53.429879 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73578f6_4d06_4dbb_863d_71ea6ebf4df9.slice/crio-6dcf5ddd8f5dfedc25ce708e7c18ab00d6e33bc716aadb1cadc7d1b0a9b7eeb5 WatchSource:0}: Error finding container 6dcf5ddd8f5dfedc25ce708e7c18ab00d6e33bc716aadb1cadc7d1b0a9b7eeb5: Status 404 returned error can't find the container with id 6dcf5ddd8f5dfedc25ce708e7c18ab00d6e33bc716aadb1cadc7d1b0a9b7eeb5 Jun 08 22:03:53.704659 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:53.704625 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fvwx" event={"ID":"d73578f6-4d06-4dbb-863d-71ea6ebf4df9","Type":"ContainerStarted","Data":"6dcf5ddd8f5dfedc25ce708e7c18ab00d6e33bc716aadb1cadc7d1b0a9b7eeb5"} Jun 08 22:03:54.710000 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:54.709963 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fvwx" event={"ID":"d73578f6-4d06-4dbb-863d-71ea6ebf4df9","Type":"ContainerStarted","Data":"d4249dfe597c0003510b5ade85370f7551a69a36b1dd041b82abd8a580545576"} Jun 08 22:03:54.710356 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:54.710023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7fvwx" event={"ID":"d73578f6-4d06-4dbb-863d-71ea6ebf4df9","Type":"ContainerStarted","Data":"0e103d1c56ecb0238f6b63fa3b0d7d93144b895368b5b4f057fae1b89346b5a5"} Jun 08 22:03:54.727623 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:54.727573 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7fvwx" podStartSLOduration=373.77051116 podStartE2EDuration="6m14.727554292s" totalImagesPullingTime="957.043132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 21:57:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:03:54.726183115 +0000 UTC m=+374.849232925" watchObservedRunningTime="2026-06-08 22:03:54.727554292 +0000 UTC m=+374.850604103" Jun 08 22:03:54.821475 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:54.821449 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:54.881297 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:54.881275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:55.510522 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:55.510493 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:03:57.256085 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:03:57.256052 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:03.668808 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:03.668770 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:03.734661 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:03.734615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:08.466261 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:08.466219 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:04:08.917539 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:08.917446 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:09.017450 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:09.017413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:09.512040 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:09.512011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:09.569511 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:09.569483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:15.637919 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:15.637885 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:15.698442 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:15.698406 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:19.622552 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:19.622516 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:19.673039 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:19.673010 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:27.426080 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:27.426045 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:27.525887 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:27.525841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:04:33.486622 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.486558 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-8c457ccb-m7l4z" podUID="8659ce3f-de46-4948-88c0-c7d070074375" containerName="console" containerID="cri-o://3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5" gracePeriod=15 Jun 08 22:04:33.737139 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.737070 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:04:33.854293 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.854258 2562 generic.go:356] "Generic (PLEG): container finished" podID="8659ce3f-de46-4948-88c0-c7d070074375" containerID="3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5" exitCode=0 Jun 08 22:04:33.854484 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.854295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c457ccb-m7l4z" event={"ID":"8659ce3f-de46-4948-88c0-c7d070074375","Type":"ContainerDied","Data":"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5"} Jun 08 22:04:33.854484 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.854311 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8c457ccb-m7l4z" Jun 08 22:04:33.854484 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.854356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8c457ccb-m7l4z" event={"ID":"8659ce3f-de46-4948-88c0-c7d070074375","Type":"ContainerDied","Data":"4bd6d2ac2daaeae0d97a8bf8df88b58e738c19979d3c8def00dee0afe2a96464"} Jun 08 22:04:33.854484 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.854385 2562 scope.go:117] "RemoveContainer" containerID="3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5" Jun 08 22:04:33.862396 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.862379 2562 scope.go:117] "RemoveContainer" containerID="3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5" Jun 08 22:04:33.862613 ip-10-0-140-66 kubenswrapper[2562]: E0608 22:04:33.862596 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5\": container with ID starting with 3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5 not found: ID does not exist" containerID="3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5" Jun 08 22:04:33.862661 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.862621 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5"} err="failed to get container status \"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5\": rpc error: code = NotFound desc = could not find container \"3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5\": container with ID starting with 3fb9631742d3af8be8bd48a78a138bff2e42cdd4b9b919d1b91d796482d8e5e5 not found: ID does not exist" Jun 08 22:04:33.906435 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906399 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906600 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906471 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r95c\" (UniqueName: \"kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906600 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906499 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906600 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906528 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906600 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906569 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906600 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906596 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906855 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906768 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config\") pod \"8659ce3f-de46-4948-88c0-c7d070074375\" (UID: \"8659ce3f-de46-4948-88c0-c7d070074375\") " Jun 08 22:04:33.906957 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.906933 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca" (OuterVolumeSpecName: "service-ca") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:04:33.907155 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.907051 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:04:33.907155 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.907114 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-oauth-serving-cert\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:33.907155 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.907130 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-service-ca\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:33.907155 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.907137 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config" (OuterVolumeSpecName: "console-config") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:04:33.907608 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.907377 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 22:04:33.908886 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.908832 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c" (OuterVolumeSpecName: "kube-api-access-7r95c") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "kube-api-access-7r95c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 22:04:33.909019 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.908997 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:04:33.909084 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:33.909047 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8659ce3f-de46-4948-88c0-c7d070074375" (UID: "8659ce3f-de46-4948-88c0-c7d070074375"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 08 22:04:34.007704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.007615 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r95c\" (UniqueName: \"kubernetes.io/projected/8659ce3f-de46-4948-88c0-c7d070074375-kube-api-access-7r95c\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:34.007704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.007644 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-trusted-ca-bundle\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:34.007704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.007654 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8659ce3f-de46-4948-88c0-c7d070074375-console-config\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:34.007704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.007663 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-serving-cert\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:34.007704 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.007671 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8659ce3f-de46-4948-88c0-c7d070074375-console-oauth-config\") on node \"ip-10-0-140-66.ec2.internal\" DevicePath \"\"" Jun 08 22:04:34.176240 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.176212 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:04:34.181509 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.181483 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8c457ccb-m7l4z"] Jun 08 22:04:34.376745 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:04:34.376679 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8659ce3f-de46-4948-88c0-c7d070074375" path="/var/lib/kubelet/pods/8659ce3f-de46-4948-88c0-c7d070074375/volumes" Jun 08 22:05:10.515004 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:05:10.514916 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:07:13.271927 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:13.271895 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:07:13.326927 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:13.326891 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:07:41.115904 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:41.115856 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 22:07:41.118370 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:41.116389 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 22:07:46.758024 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:46.757988 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:07:48.894928 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:48.894892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:07:59.218120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:07:59.218031 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:13.367778 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:13.367743 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:14.926926 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:14.926890 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:16.777168 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:16.777136 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:16.877432 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:16.877392 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:18.861610 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:18.861573 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:18.968236 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:18.968204 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:21.576724 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:21.576687 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:21.676984 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:21.676947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:22.409057 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:22.409011 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:22.816623 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:22.816590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:24.429596 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:24.429559 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:24.529975 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:24.529947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:26.995133 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:26.995097 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:27.118297 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:27.118256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:29.911002 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:29.910969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:40.813928 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:40.813892 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:40.903999 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:40.903963 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:52.870543 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:52.870498 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:52.971158 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:52.971119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:08:54.743430 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743398 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2"] Jun 08 22:08:54.743915 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743779 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerName="console" Jun 08 22:08:54.743915 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743795 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerName="console" Jun 08 22:08:54.743915 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743822 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8659ce3f-de46-4948-88c0-c7d070074375" containerName="console" Jun 08 22:08:54.743915 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743830 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8659ce3f-de46-4948-88c0-c7d070074375" containerName="console" Jun 08 22:08:54.744129 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743924 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6adda4-b9a1-4abd-ad21-da36e3b0d667" containerName="console" Jun 08 22:08:54.744129 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.743937 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8659ce3f-de46-4948-88c0-c7d070074375" containerName="console" Jun 08 22:08:54.746758 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.746738 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.748838 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.748818 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 08 22:08:54.748962 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.748847 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 08 22:08:54.749356 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.749340 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-7cl6d\"" Jun 08 22:08:54.754341 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.754313 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2"] Jun 08 22:08:54.778913 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.778887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-tmp\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.779009 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.778926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wglg\" (UniqueName: \"kubernetes.io/projected/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-kube-api-access-4wglg\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.879824 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.879795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wglg\" (UniqueName: \"kubernetes.io/projected/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-kube-api-access-4wglg\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.879944 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.879860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-tmp\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.880198 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.880181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-tmp\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:54.888355 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:54.888331 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wglg\" (UniqueName: \"kubernetes.io/projected/217a293e-0cc0-42b4-a8f1-ee22bdf5c655-kube-api-access-4wglg\") pod \"jobset-operator-5bc45f897-h5nx2\" (UID: \"217a293e-0cc0-42b4-a8f1-ee22bdf5c655\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:55.069798 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:55.069715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" Jun 08 22:08:55.197362 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:55.197332 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2"] Jun 08 22:08:55.201232 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:08:55.201210 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod217a293e_0cc0_42b4_a8f1_ee22bdf5c655.slice/crio-411c894a00636fec4808bf3e8a698d78c0b7dbd883c2753c1547e0683622f979 WatchSource:0}: Error finding container 411c894a00636fec4808bf3e8a698d78c0b7dbd883c2753c1547e0683622f979: Status 404 returned error can't find the container with id 411c894a00636fec4808bf3e8a698d78c0b7dbd883c2753c1547e0683622f979 Jun 08 22:08:55.202620 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:55.202602 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 22:08:55.796047 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:55.796010 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" event={"ID":"217a293e-0cc0-42b4-a8f1-ee22bdf5c655","Type":"ContainerStarted","Data":"411c894a00636fec4808bf3e8a698d78c0b7dbd883c2753c1547e0683622f979"} Jun 08 22:08:58.809884 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:58.809844 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" event={"ID":"217a293e-0cc0-42b4-a8f1-ee22bdf5c655","Type":"ContainerStarted","Data":"1ca658c5d7a2316611b7778281919551eed7f1e037fe36526f854b644818a8cc"} Jun 08 22:08:58.831340 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:08:58.826845 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-h5nx2" podStartSLOduration=2.215754055 podStartE2EDuration="4.826824489s" totalImagesPullingTime="2.611070434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:08:58.825626144 +0000 UTC m=+678.948675954" watchObservedRunningTime="2026-06-08 22:08:58.826824489 +0000 UTC m=+678.949874300" Jun 08 22:09:02.075541 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:02.075511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:02.484627 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:02.484588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:02.546087 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:02.546049 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:03.789649 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:03.789614 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:03.880973 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:03.880940 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:04.359512 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:04.359465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:14.950496 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:14.950463 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:15.053743 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:15.053710 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:15.129815 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:15.129778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:19.059974 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:19.059938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:19.161319 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:19.161282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:21.964319 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.964244 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk"] Jun 08 22:09:21.970887 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.970845 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:21.972904 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.972856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 08 22:09:21.973036 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.973009 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 22:09:21.973463 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.973443 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 22:09:21.973532 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.973451 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-t2c9t\"" Jun 08 22:09:21.973859 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.973814 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 08 22:09:21.976127 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.976102 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:21.976617 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:21.976598 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk"] Jun 08 22:09:22.094301 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.094273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c3487426-f12f-47fd-ac5a-1347345a2708-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.094301 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.094302 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txlrj\" (UniqueName: \"kubernetes.io/projected/c3487426-f12f-47fd-ac5a-1347345a2708-kube-api-access-txlrj\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.094456 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.094331 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3487426-f12f-47fd-ac5a-1347345a2708-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.195198 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.195160 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3487426-f12f-47fd-ac5a-1347345a2708-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.195366 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.195228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c3487426-f12f-47fd-ac5a-1347345a2708-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.195366 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.195249 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txlrj\" (UniqueName: \"kubernetes.io/projected/c3487426-f12f-47fd-ac5a-1347345a2708-kube-api-access-txlrj\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.195925 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.195897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/c3487426-f12f-47fd-ac5a-1347345a2708-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.197573 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.197555 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3487426-f12f-47fd-ac5a-1347345a2708-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.203291 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.203268 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txlrj\" (UniqueName: \"kubernetes.io/projected/c3487426-f12f-47fd-ac5a-1347345a2708-kube-api-access-txlrj\") pod \"kubeflow-trainer-controller-manager-857f77d56c-x2pvk\" (UID: \"c3487426-f12f-47fd-ac5a-1347345a2708\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.204563 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.204540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:22.281760 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.281685 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:22.408747 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.408717 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk"] Jun 08 22:09:22.411513 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:09:22.411493 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3487426_f12f_47fd_ac5a_1347345a2708.slice/crio-9b3262bfd3e918801737de9fab51d8c371b7a25056e30689c95cd72f95ac635a WatchSource:0}: Error finding container 9b3262bfd3e918801737de9fab51d8c371b7a25056e30689c95cd72f95ac635a: Status 404 returned error can't find the container with id 9b3262bfd3e918801737de9fab51d8c371b7a25056e30689c95cd72f95ac635a Jun 08 22:09:22.896828 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:22.896792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" event={"ID":"c3487426-f12f-47fd-ac5a-1347345a2708","Type":"ContainerStarted","Data":"9b3262bfd3e918801737de9fab51d8c371b7a25056e30689c95cd72f95ac635a"} Jun 08 22:09:25.902046 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:25.902008 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:25.910812 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:25.910777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" event={"ID":"c3487426-f12f-47fd-ac5a-1347345a2708","Type":"ContainerStarted","Data":"74dc407dbf98f20ed22338eb5ff4675d8e515ff2149a35deeb2fd9f77d394afe"} Jun 08 22:09:25.910980 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:25.910837 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:25.928268 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:25.928224 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" podStartSLOduration=2.38541525 podStartE2EDuration="4.928210456s" totalImagesPullingTime="2.542795206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:09:25.926678261 +0000 UTC m=+706.049728072" watchObservedRunningTime="2026-06-08 22:09:25.928210456 +0000 UTC m=+706.051260279" Jun 08 22:09:41.591197 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:41.591154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:41.695169 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:41.695133 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:41.920278 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:41.920207 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-x2pvk" Jun 08 22:09:51.948970 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:51.948923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:09:52.050995 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:09:52.050962 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:11:16.512550 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:11:16.512515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:11:16.575686 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:11:16.575644 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:11:33.488413 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:11:33.488377 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-x2pvk_c3487426-f12f-47fd-ac5a-1347345a2708/manager/0.log" Jun 08 22:11:33.999137 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:11:33.999108 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-x2pvk_c3487426-f12f-47fd-ac5a-1347345a2708/manager/0.log" Jun 08 22:11:34.485703 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:11:34.485674 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-x2pvk_c3487426-f12f-47fd-ac5a-1347345a2708/manager/0.log" Jun 08 22:12:11.613046 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.613002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:11.755940 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.755908 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jbsh8/must-gather-548zc"] Jun 08 22:12:11.759175 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.759156 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.761984 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.761959 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jbsh8\"/\"kube-root-ca.crt\"" Jun 08 22:12:11.762089 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.762006 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jbsh8\"/\"openshift-service-ca.crt\"" Jun 08 22:12:11.762465 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.762431 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jbsh8\"/\"default-dockercfg-tgp7v\"" Jun 08 22:12:11.763321 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.763299 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:11.767911 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.767889 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jbsh8/must-gather-548zc"] Jun 08 22:12:11.823068 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.823043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89e75f8d-ed1f-4499-a192-1d59a3b88425-must-gather-output\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.823177 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.823073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndhxh\" (UniqueName: \"kubernetes.io/projected/89e75f8d-ed1f-4499-a192-1d59a3b88425-kube-api-access-ndhxh\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.828284 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.828258 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:11.923803 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.923745 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89e75f8d-ed1f-4499-a192-1d59a3b88425-must-gather-output\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.923803 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.923776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndhxh\" (UniqueName: \"kubernetes.io/projected/89e75f8d-ed1f-4499-a192-1d59a3b88425-kube-api-access-ndhxh\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.924170 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.924154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/89e75f8d-ed1f-4499-a192-1d59a3b88425-must-gather-output\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:11.936594 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:11.936565 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndhxh\" (UniqueName: \"kubernetes.io/projected/89e75f8d-ed1f-4499-a192-1d59a3b88425-kube-api-access-ndhxh\") pod \"must-gather-548zc\" (UID: \"89e75f8d-ed1f-4499-a192-1d59a3b88425\") " pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:12.069040 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:12.069003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jbsh8/must-gather-548zc" Jun 08 22:12:12.197470 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:12.197300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jbsh8/must-gather-548zc"] Jun 08 22:12:12.200306 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:12:12.200275 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89e75f8d_ed1f_4499_a192_1d59a3b88425.slice/crio-794ea5ce92c2601c6daaad078093b430e0a17514ef026464f2bdec2f40cf20d4 WatchSource:0}: Error finding container 794ea5ce92c2601c6daaad078093b430e0a17514ef026464f2bdec2f40cf20d4: Status 404 returned error can't find the container with id 794ea5ce92c2601c6daaad078093b430e0a17514ef026464f2bdec2f40cf20d4 Jun 08 22:12:12.528213 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:12.528131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jbsh8/must-gather-548zc" event={"ID":"89e75f8d-ed1f-4499-a192-1d59a3b88425","Type":"ContainerStarted","Data":"794ea5ce92c2601c6daaad078093b430e0a17514ef026464f2bdec2f40cf20d4"} Jun 08 22:12:13.534591 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:13.534555 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jbsh8/must-gather-548zc" event={"ID":"89e75f8d-ed1f-4499-a192-1d59a3b88425","Type":"ContainerStarted","Data":"0bec309e4d21567bb7576bfed00a1f0d58a91c8433d60adc9a9844cacb222c77"} Jun 08 22:12:13.535023 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:13.534602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jbsh8/must-gather-548zc" event={"ID":"89e75f8d-ed1f-4499-a192-1d59a3b88425","Type":"ContainerStarted","Data":"2f2431bf10806a77b85d427a19f9dfa75e974dbb2b276abeae0be890c416de69"} Jun 08 22:12:13.549437 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:13.549375 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jbsh8/must-gather-548zc" podStartSLOduration=1.7946871629999999 podStartE2EDuration="2.549352698s" totalImagesPullingTime="754.665535ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 22:12:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:12:13.548651159 +0000 UTC m=+873.671700970" watchObservedRunningTime="2026-06-08 22:12:13.549352698 +0000 UTC m=+873.672402509" Jun 08 22:12:14.337651 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:14.337608 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-2sljn_2247955b-3ca6-419f-9173-b0f85c6bdc1b/global-pull-secret-syncer/0.log" Jun 08 22:12:14.416184 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:14.416143 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" Jun 08 22:12:14.539982 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:14.538104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-66.ec2.internal_56554d0b4ec320ab1a2afe7ff9f853be/haproxy/0.log" Jun 08 22:12:17.188317 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:17.188279 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:17.286287 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:17.286245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:18.280207 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.280175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjslp_ef049d98-30be-435b-890c-f2bfcf30d016/node-exporter/0.log" Jun 08 22:12:18.315579 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.315540 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjslp_ef049d98-30be-435b-890c-f2bfcf30d016/kube-rbac-proxy/0.log" Jun 08 22:12:18.352098 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.351989 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rjslp_ef049d98-30be-435b-890c-f2bfcf30d016/init-textfile/0.log" Jun 08 22:12:18.393684 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.393568 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9jdxm_7487f93e-4fd7-4a8e-a6b0-63212d62495f/kube-rbac-proxy-main/0.log" Jun 08 22:12:18.427580 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.427543 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9jdxm_7487f93e-4fd7-4a8e-a6b0-63212d62495f/kube-rbac-proxy-self/0.log" Jun 08 22:12:18.463652 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.463598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-9jdxm_7487f93e-4fd7-4a8e-a6b0-63212d62495f/openshift-state-metrics/0.log" Jun 08 22:12:18.507482 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.507456 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/prometheus/0.log" Jun 08 22:12:18.536260 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.536177 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/config-reloader/0.log" Jun 08 22:12:18.565321 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.565249 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/thanos-sidecar/0.log" Jun 08 22:12:18.591673 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.591649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/kube-rbac-proxy-web/0.log" Jun 08 22:12:18.622006 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.621955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/kube-rbac-proxy/0.log" Jun 08 22:12:18.646260 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.646221 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/kube-rbac-proxy-thanos/0.log" Jun 08 22:12:18.668424 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.668395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_986491b2-b82c-4660-a7e0-6cd0640550dc/init-config-reloader/0.log" Jun 08 22:12:18.697802 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.697774 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v9h7c_ff1f7118-cda3-4725-afc2-1163ab0f3d0c/prometheus-operator/0.log" Jun 08 22:12:18.724553 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.724518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v9h7c_ff1f7118-cda3-4725-afc2-1163ab0f3d0c/kube-rbac-proxy/0.log" Jun 08 22:12:18.759080 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:18.759048 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-lfpk5_79971a79-4fa8-4ff9-ae06-6408b18b1979/prometheus-operator-admission-webhook/0.log" Jun 08 22:12:21.322565 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:21.322469 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-hmjvp_acb3dab4-e66c-4d22-9f59-b4ce712c6c4e/download-server/0.log" Jun 08 22:12:22.431129 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.431090 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg"] Jun 08 22:12:22.434755 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.434724 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.444497 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.444470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg"] Jun 08 22:12:22.521519 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.521484 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-podres\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.521519 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.521526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-lib-modules\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.521741 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.521551 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t6wh\" (UniqueName: \"kubernetes.io/projected/26797b0b-1078-4637-8d36-f2a4e105571e-kube-api-access-7t6wh\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.521741 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.521589 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-proc\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.521741 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.521624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-sys\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622273 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-sys\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622456 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-podres\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622456 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-lib-modules\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622456 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t6wh\" (UniqueName: \"kubernetes.io/projected/26797b0b-1078-4637-8d36-f2a4e105571e-kube-api-access-7t6wh\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622456 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-proc\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622689 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-proc\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622689 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-sys\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622797 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-podres\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.622797 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.622778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26797b0b-1078-4637-8d36-f2a4e105571e-lib-modules\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.631039 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.631009 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t6wh\" (UniqueName: \"kubernetes.io/projected/26797b0b-1078-4637-8d36-f2a4e105571e-kube-api-access-7t6wh\") pod \"perf-node-gather-daemonset-jcxhg\" (UID: \"26797b0b-1078-4637-8d36-f2a4e105571e\") " pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.749592 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.749564 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:22.789203 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.789169 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjc5n_c95acc29-4ad3-45dd-a646-2c439bd0a6e9/dns/0.log" Jun 08 22:12:22.810782 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.810751 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-rjc5n_c95acc29-4ad3-45dd-a646-2c439bd0a6e9/kube-rbac-proxy/0.log" Jun 08 22:12:22.834918 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.834892 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7flpz_03411705-2d29-4134-9ede-ade8a24b8d87/dns-node-resolver/0.log" Jun 08 22:12:22.880258 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:22.880235 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg"] Jun 08 22:12:22.882879 ip-10-0-140-66 kubenswrapper[2562]: W0608 22:12:22.882830 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod26797b0b_1078_4637_8d36_f2a4e105571e.slice/crio-fd61dc29fbbcd225557037ff74f56af27bfc85229a7affc452b866623d934cde WatchSource:0}: Error finding container fd61dc29fbbcd225557037ff74f56af27bfc85229a7affc452b866623d934cde: Status 404 returned error can't find the container with id fd61dc29fbbcd225557037ff74f56af27bfc85229a7affc452b866623d934cde Jun 08 22:12:23.347590 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:23.347557 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k2wvd_354705d3-adde-4fdb-b29f-59477933fca3/node-ca/0.log" Jun 08 22:12:23.589443 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:23.589403 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" event={"ID":"26797b0b-1078-4637-8d36-f2a4e105571e","Type":"ContainerStarted","Data":"55c93632b415da83e9f7c117d2f5c1ad05e1a29ac15dfe137f1c44f45c83c16a"} Jun 08 22:12:23.589856 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:23.589465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" event={"ID":"26797b0b-1078-4637-8d36-f2a4e105571e","Type":"ContainerStarted","Data":"fd61dc29fbbcd225557037ff74f56af27bfc85229a7affc452b866623d934cde"} Jun 08 22:12:23.589856 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:23.589551 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:23.605165 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:23.605058 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" podStartSLOduration=1.605043006 podStartE2EDuration="1.605043006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 22:12:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 22:12:23.60434658 +0000 UTC m=+883.727396386" watchObservedRunningTime="2026-06-08 22:12:23.605043006 +0000 UTC m=+883.728092815" Jun 08 22:12:24.072934 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:24.072903 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-69667599d7-c7qmw_9c08e959-7140-4322-bb8e-47c231c0af19/router/0.log" Jun 08 22:12:24.407732 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:24.407649 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-22jqd_74a2419c-b62a-490b-83f5-299136bde102/serve-healthcheck-canary/0.log" Jun 08 22:12:24.849182 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:24.849147 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjgcj_8e6226e8-b8fd-4b51-93b3-b848fbb3325a/kube-rbac-proxy/0.log" Jun 08 22:12:24.869120 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:24.869092 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjgcj_8e6226e8-b8fd-4b51-93b3-b848fbb3325a/exporter/0.log" Jun 08 22:12:24.890069 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:24.890040 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fjgcj_8e6226e8-b8fd-4b51-93b3-b848fbb3325a/extractor/0.log" Jun 08 22:12:26.634467 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:26.634434 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-h5nx2_217a293e-0cc0-42b4-a8f1-ee22bdf5c655/jobset-operator/0.log" Jun 08 22:12:29.606017 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:29.605987 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jbsh8/perf-node-gather-daemonset-jcxhg" Jun 08 22:12:30.923649 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:30.923617 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-66spw_b8e71d9a-7855-47a5-9cd7-a5ec09616e8e/kube-multus/0.log" Jun 08 22:12:31.108332 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.108311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/kube-multus-additional-cni-plugins/0.log" Jun 08 22:12:31.134528 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.134502 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/egress-router-binary-copy/0.log" Jun 08 22:12:31.155604 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.155579 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/cni-plugins/0.log" Jun 08 22:12:31.175415 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.175388 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/bond-cni-plugin/0.log" Jun 08 22:12:31.210145 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.210111 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/routeoverride-cni/0.log" Jun 08 22:12:31.243067 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.243030 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/whereabouts-cni-bincopy/0.log" Jun 08 22:12:31.271390 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.271360 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dp75n_1b20c166-9167-4e40-894d-938100e4e557/whereabouts-cni/0.log" Jun 08 22:12:31.577890 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.577832 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fvwx_d73578f6-4d06-4dbb-863d-71ea6ebf4df9/network-metrics-daemon/0.log" Jun 08 22:12:31.599371 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:31.599342 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7fvwx_d73578f6-4d06-4dbb-863d-71ea6ebf4df9/kube-rbac-proxy/0.log" Jun 08 22:12:32.426183 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.426156 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-controller/0.log" Jun 08 22:12:32.445460 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.445427 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/1.log" Jun 08 22:12:32.445610 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.445514 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovn-acl-logging/0.log" Jun 08 22:12:32.466467 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.466445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/kube-rbac-proxy-node/0.log" Jun 08 22:12:32.492041 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.492017 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/kube-rbac-proxy-ovn-metrics/0.log" Jun 08 22:12:32.511883 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.511828 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/northd/0.log" Jun 08 22:12:32.534739 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.534714 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/nbdb/0.log" Jun 08 22:12:32.558803 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.558784 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/sbdb/0.log" Jun 08 22:12:32.616420 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:32.616380 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7sxpr_802c71df-0443-447c-b19a-1adfb72e7314/ovnkube-controller/0.log" Jun 08 22:12:34.182151 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:34.182119 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-lkgzv_47163887-c99e-4309-8e83-491f91e95eae/check-endpoints/0.log" Jun 08 22:12:34.290706 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:34.290675 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tcxh4_a7654612-12fc-423f-9530-b46da5fb1e70/network-check-target-container/0.log" Jun 08 22:12:35.275995 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:35.275964 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vvx7d_a1248aa9-d0c7-41f9-b502-1013aef626d6/iptables-alerter/0.log" Jun 08 22:12:36.036517 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:36.036477 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-mzwn9_b33c8c0e-907f-4a28-8e5f-f7471b1ef45f/tuned/0.log" Jun 08 22:12:38.091635 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:38.091590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:38.159604 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:38.159565 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2zbzb_c86124b9-2208-42b3-8365-9c0b4bd09e26/konnectivity-agent/0.log" limit=1024 Jun 08 22:12:38.673182 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:38.673152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-clp6j_de9e1433-0a40-4d8a-995c-8864fbc45b05/service-ca-operator/1.log" Jun 08 22:12:38.675442 ip-10-0-140-66 kubenswrapper[2562]: I0608 22:12:38.675417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-6bc5ff68f5-clp6j_de9e1433-0a40-4d8a-995c-8864fbc45b05/service-ca-operator/0.log"