Jun 05 20:28:15.623777 ip-10-0-133-23 systemd[1]: Starting Kubernetes Kubelet... Jun 05 20:28:16.081632 ip-10-0-133-23 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:28:16.081632 ip-10-0-133-23 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 20:28:16.081632 ip-10-0-133-23 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:28:16.081632 ip-10-0-133-23 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 20:28:16.081632 ip-10-0-133-23 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 20:28:16.082804 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.081701 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 20:28:16.085262 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085246 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.085262 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085262 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085267 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085270 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085274 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085277 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085280 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085282 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085285 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085288 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085293 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085296 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085299 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085307 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085310 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085313 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085316 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085318 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085321 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085323 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.085327 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085326 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085329 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085332 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085335 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085338 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085340 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085343 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085345 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085348 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085350 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085353 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085355 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085358 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085361 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085363 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085366 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085370 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085373 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085377 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.085797 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085380 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085382 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085385 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085388 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085390 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085393 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085395 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085397 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085400 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085402 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085405 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085412 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085415 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085417 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085420 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085424 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085427 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085429 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085432 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085434 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.086367 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085437 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085439 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085442 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085444 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085447 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085450 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085452 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085455 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085458 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085460 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085463 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085465 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085469 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085472 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085474 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085489 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085493 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085495 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085498 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.087124 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085501 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085504 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085506 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085509 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085512 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085515 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085522 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085526 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085529 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085532 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085535 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085538 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085541 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085543 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085546 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085549 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085551 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085554 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085556 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085559 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.087651 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.085562 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.089900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089883 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.089900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089899 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089904 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089908 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089911 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089915 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089918 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089921 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089928 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089931 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089934 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089938 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089940 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089943 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089946 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089950 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089955 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089959 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089962 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089965 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.089964 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089968 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089974 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089977 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089980 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089983 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089986 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089988 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089991 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089994 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089996 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.089999 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090001 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090004 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090009 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090013 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090016 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090018 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090021 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090024 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090027 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.090434 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090030 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090033 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090035 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090038 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090041 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090043 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090048 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090051 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090053 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090056 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090059 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090062 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090065 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090067 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090071 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090074 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090077 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090080 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090085 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090088 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.090952 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090091 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090093 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090096 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090099 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090101 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090104 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090107 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090109 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090112 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090115 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090121 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090124 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090126 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090131 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090134 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090137 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090140 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090144 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090147 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.091445 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090151 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090154 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090157 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090162 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090165 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090168 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090170 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090174 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090177 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090180 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090183 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090185 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090188 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090192 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090196 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090201 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090204 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090207 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090210 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.091938 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090213 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090841 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090847 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090850 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090852 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090856 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090859 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090861 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090864 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090867 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090874 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090878 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090882 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090885 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090889 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090892 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090894 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090897 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090900 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.092435 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090904 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090908 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090911 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090917 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090920 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090923 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090926 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090928 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090931 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090934 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090937 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090940 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090943 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090946 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090948 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090954 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090957 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090960 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090963 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090967 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.092920 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090970 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090973 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090976 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090978 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090981 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090984 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090986 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090989 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090994 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090996 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.090999 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091001 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091004 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091007 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091010 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091013 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091016 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091018 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091022 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091025 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.093399 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091030 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091032 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091035 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091037 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091040 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091043 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091046 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091048 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091051 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091054 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091056 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091059 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091063 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091068 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091071 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091074 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091076 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091079 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091082 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091085 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.093900 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091088 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091092 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091095 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091098 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091103 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091106 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091108 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091111 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091114 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091116 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091119 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091122 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091124 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091127 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091130 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091133 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091135 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091140 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091143 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091146 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.094381 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.091149 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091506 2583 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091521 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091528 2583 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091533 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091538 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091542 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091548 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091555 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091560 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091563 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091566 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091569 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091572 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091575 2583 flags.go:64] FLAG: --cgroup-root="" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091579 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091583 2583 flags.go:64] FLAG: --client-ca-file="" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091586 2583 flags.go:64] FLAG: --cloud-provider="external" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091588 2583 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091593 2583 flags.go:64] FLAG: --cluster-domain="" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091596 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091599 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091602 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091606 2583 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 20:28:16.094894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091610 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091613 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091616 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091619 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091622 2583 flags.go:64] FLAG: --contention-profiling="false" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091625 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091628 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091631 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091634 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091642 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091648 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091651 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091655 2583 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091658 2583 flags.go:64] FLAG: --enable-server="true" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091661 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091665 2583 flags.go:64] FLAG: --event-burst="100" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091668 2583 flags.go:64] FLAG: --event-qps="50" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091671 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091674 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091677 2583 flags.go:64] FLAG: --eviction-hard="" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091681 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091684 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091687 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091690 2583 flags.go:64] FLAG: --eviction-soft="" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091693 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 20:28:16.095470 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091696 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091698 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091701 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091704 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091707 2583 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091710 2583 flags.go:64] FLAG: --feature-gates="" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091713 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091716 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091719 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091722 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091725 2583 flags.go:64] FLAG: --healthz-port="10248" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091728 2583 flags.go:64] FLAG: --help="false" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091731 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091734 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091738 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091741 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091745 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091750 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091753 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091756 2583 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091759 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091762 2583 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091765 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091768 2583 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 20:28:16.096103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091771 2583 flags.go:64] FLAG: --kube-reserved="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091774 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091776 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091779 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091782 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091785 2583 flags.go:64] FLAG: --lock-file="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091788 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091791 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091794 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091799 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091802 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091805 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091808 2583 flags.go:64] FLAG: --logging-format="text" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091810 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091813 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091817 2583 flags.go:64] FLAG: --manifest-url="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091820 2583 flags.go:64] FLAG: --manifest-url-header="" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091824 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091827 2583 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091831 2583 flags.go:64] FLAG: --max-pods="110" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091834 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091837 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091840 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091843 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091846 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 20:28:16.096753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091851 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091854 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091861 2583 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091864 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091872 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091875 2583 flags.go:64] FLAG: --pod-cidr="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091878 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091884 2583 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091886 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091890 2583 flags.go:64] FLAG: --pods-per-core="0" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091892 2583 flags.go:64] FLAG: --port="10250" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091895 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091898 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-087722ac483b5b4f5" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091901 2583 flags.go:64] FLAG: --qos-reserved="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091904 2583 flags.go:64] FLAG: --read-only-port="10255" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091907 2583 flags.go:64] FLAG: --register-node="true" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091910 2583 flags.go:64] FLAG: --register-with-taints="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091914 2583 flags.go:64] FLAG: --registry-burst="10" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091918 2583 flags.go:64] FLAG: --registry-qps="5" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091921 2583 flags.go:64] FLAG: --reserved-cpus="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091923 2583 flags.go:64] FLAG: --reserved-memory="" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091927 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091930 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091933 2583 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091936 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 20:28:16.097358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091939 2583 flags.go:64] FLAG: --runonce="false" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091942 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091946 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091949 2583 flags.go:64] FLAG: --seccomp-default="false" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091952 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091955 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091959 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091962 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091966 2583 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091969 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091972 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091975 2583 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091978 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091981 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091984 2583 flags.go:64] FLAG: --system-cgroups="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091987 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091992 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091995 2583 flags.go:64] FLAG: --tls-cert-file="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.091998 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092003 2583 flags.go:64] FLAG: --tls-min-version="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092005 2583 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092008 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092011 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092014 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092017 2583 flags.go:64] FLAG: --v="2" Jun 05 20:28:16.097989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092021 2583 flags.go:64] FLAG: --version="false" Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092025 2583 flags.go:64] FLAG: --vmodule="" Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092029 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.092033 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092155 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092159 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092162 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092165 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092168 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092171 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092174 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092177 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092180 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092183 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092186 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092192 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092194 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092197 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092199 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092204 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.098750 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092207 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092210 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092213 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092216 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092219 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092222 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092224 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092228 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092231 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092234 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092237 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092239 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092242 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092245 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092248 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092251 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092254 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092256 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092259 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092261 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.099665 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092264 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092266 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092269 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092272 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092274 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092277 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092279 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092283 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092286 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092289 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092291 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092294 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092297 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092299 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092302 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092304 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092307 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092311 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092314 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092317 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.100629 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092319 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092322 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092324 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092327 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092329 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092332 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092335 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092338 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092340 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092343 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092345 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092348 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092351 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092353 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092356 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092358 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092361 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092364 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092366 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.101476 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092370 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092373 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092375 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092378 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092380 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092383 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092386 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092388 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092391 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092393 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092396 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092399 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092401 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092404 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092408 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092411 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092414 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092417 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092420 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092423 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.102316 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092426 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092429 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092432 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.092435 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.093292 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.100980 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.101000 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.101022 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.101031 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101117 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101125 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101131 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101136 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101141 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.102947 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101145 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101150 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101155 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101160 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101165 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101169 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101174 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101178 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101183 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101188 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101192 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101196 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101201 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101205 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101211 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101217 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101221 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101225 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101230 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101236 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.103585 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101240 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101244 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101249 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101253 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101258 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101263 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101267 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101272 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101276 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101281 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101285 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101290 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101294 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101299 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101303 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101307 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101313 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101317 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101322 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101326 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.104136 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101330 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101335 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101339 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101343 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101347 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101351 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101356 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101360 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101365 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101372 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101377 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101383 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101394 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101400 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101405 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101410 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101415 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101419 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101424 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.104944 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101428 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101432 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101436 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101440 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101445 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101449 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101453 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101458 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101462 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101466 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101471 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101475 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101500 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101504 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101508 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101512 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101517 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101521 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101525 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.105460 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101529 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101533 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101538 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101542 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101547 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101551 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101555 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101561 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101565 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101569 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101573 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101578 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101582 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101586 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101590 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.106069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101593 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.101601 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101812 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101821 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101826 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101831 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101835 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101840 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101844 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101848 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101853 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101857 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101861 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101866 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101870 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 20:28:16.106463 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101874 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101878 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101882 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101887 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101891 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101895 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101899 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101903 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101908 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101912 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101918 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101922 2583 feature_gate.go:328] unrecognized feature gate: Example Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101926 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101930 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101934 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101938 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101942 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101947 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101951 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101955 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 20:28:16.106862 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101959 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101963 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101967 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101971 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101976 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101980 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101984 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101988 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101993 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.101998 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102002 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102006 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102010 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102014 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102018 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102022 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102027 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102031 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102035 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102040 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 20:28:16.107392 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102044 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102048 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102053 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102057 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102061 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102065 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102069 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102074 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102078 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102082 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102086 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102090 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102094 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102099 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102103 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102109 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102114 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102119 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102125 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 20:28:16.107950 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102131 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102136 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102140 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102145 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102150 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102155 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102160 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102165 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102169 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102173 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102178 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102182 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102186 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102191 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102195 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102199 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102204 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102209 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102213 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 20:28:16.108420 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102217 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102223 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102228 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102233 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102238 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102242 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102247 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:16.102251 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.102260 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.102414 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.105638 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.107043 2583 server.go:1019] "Starting client certificate rotation" Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.107150 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:28:16.108959 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.107185 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 20:28:16.110630 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.110610 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:28:16.112104 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.112080 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 20:28:16.125295 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.125276 2583 log.go:25] "Validated CRI v1 runtime API" Jun 05 20:28:16.129220 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.129204 2583 log.go:25] "Validated CRI v1 image API" Jun 05 20:28:16.129994 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.129976 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 20:28:16.135601 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.135573 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b816594b-7425-45a5-a0eb-2662dd29ed43:/dev/nvme0n1p4 e936d22d-afc7-4c2f-b9cc-aa69e95e1df4:/dev/nvme0n1p3] Jun 05 20:28:16.135682 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.135599 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 20:28:16.136182 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.136156 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:28:16.141371 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.141263 2583 manager.go:216] Machine: {Timestamp:2026-06-05 20:28:16.140075579 +0000 UTC m=+0.377742904 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100637 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21ce270e1a3a6fe8ef35341169b4f1 SystemUUID:ec21ce27-0e1a-3a6f-e8ef-35341169b4f1 BootID:0a47bb03-01ad-4ced-9844-4ff4c64a7f1e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:77:d4:2a:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:77:d4:2a:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:9f:e5:4c:d0:5b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 20:28:16.141371 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.141367 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 20:28:16.141500 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.141492 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 20:28:16.142867 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.142844 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 20:28:16.143004 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.142870 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-23.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 20:28:16.143632 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.143622 2583 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 20:28:16.143669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.143634 2583 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 20:28:16.143669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.143641 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:28:16.144529 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.144518 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 20:28:16.145361 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.145352 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 20:28:16.148195 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148184 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:28:16.148301 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148292 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 20:28:16.148331 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148322 2583 kubelet.go:486] "Attempting to sync node with API server" Jun 05 20:28:16.148359 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148332 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 20:28:16.148359 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148345 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 20:28:16.148359 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148355 2583 kubelet.go:398] "Adding apiserver pod source" Jun 05 20:28:16.148446 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148363 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 20:28:16.148814 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148801 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:28:16.148873 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.148819 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 20:28:16.151569 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.151553 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 20:28:16.152055 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.152036 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2vvln" Jun 05 20:28:16.152968 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.152952 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 20:28:16.153042 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.152991 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 20:28:16.153632 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153619 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153637 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153644 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153649 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153658 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153665 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153689 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153694 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153701 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 20:28:16.153704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153707 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 20:28:16.153942 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153721 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 20:28:16.153942 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.153730 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 20:28:16.154574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.154564 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 20:28:16.154574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.154573 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 20:28:16.157216 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.157174 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-23.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 20:28:16.157297 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.157231 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-23.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 20:28:16.157297 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.157268 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 20:28:16.157815 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.157802 2583 server.go:1268] "Started kubelet" Jun 05 20:28:16.157889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.157861 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 20:28:16.157944 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.157884 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 20:28:16.157988 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.157950 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 20:28:16.158716 ip-10-0-133-23 systemd[1]: Started Kubernetes Kubelet. Jun 05 20:28:16.159831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.159668 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 20:28:16.161001 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.160986 2583 server.go:310] "Adding debug handlers to kubelet server" Jun 05 20:28:16.164419 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.164402 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2vvln" Jun 05 20:28:16.165441 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.165422 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 20:28:16.165766 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.165744 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 20:28:16.166419 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.166403 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 20:28:16.166546 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.166416 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 20:28:16.166626 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.166617 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 20:28:16.166694 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.166673 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 20:28:16.166740 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.166449 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.166890 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.166876 2583 reconstruct.go:97] "Volume reconstruction finished" Jun 05 20:28:16.166946 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.166891 2583 reconciler.go:29] "Reconciler: start to sync state" Jun 05 20:28:16.167753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.167735 2583 factory.go:55] Registering systemd factory Jun 05 20:28:16.167753 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.167755 2583 factory.go:223] Registration of the systemd container factory successfully Jun 05 20:28:16.171574 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.167595 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-23.ec2.internal.18b6494ca21d2908 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-23.ec2.internal,UID:ip-10-0-133-23.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-23.ec2.internal,},FirstTimestamp:2026-06-05 20:28:16.15777204 +0000 UTC m=+0.395439345,LastTimestamp:2026-06-05 20:28:16.15777204 +0000 UTC m=+0.395439345,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-23.ec2.internal,}" Jun 05 20:28:16.171666 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.171621 2583 factory.go:153] Registering CRI-O factory Jun 05 20:28:16.171666 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.171637 2583 factory.go:223] Registration of the crio container factory successfully Jun 05 20:28:16.171762 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.171723 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 20:28:16.171762 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.171750 2583 factory.go:103] Registering Raw factory Jun 05 20:28:16.171856 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.171766 2583 manager.go:1196] Started watching for new ooms in manager Jun 05 20:28:16.172159 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.172142 2583 manager.go:349] Starting recovery of all containers Jun 05 20:28:16.174557 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.174532 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:16.177930 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.177910 2583 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-133-23.ec2.internal\" not found" node="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.181615 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.181599 2583 manager.go:354] Recovery completed Jun 05 20:28:16.183001 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.182978 2583 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 05 20:28:16.185714 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.185701 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.187574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.187561 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.187630 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.187588 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.187630 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.187602 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.188088 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188070 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 20:28:16.188088 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188087 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 20:28:16.188162 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188103 2583 state_mem.go:36] "Initialized new in-memory state store" Jun 05 20:28:16.188162 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188076 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.188951 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188935 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.189004 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188961 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.189004 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.188970 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.189410 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.189395 2583 policy_none.go:49] "None policy: Start" Jun 05 20:28:16.189410 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.189412 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 20:28:16.189534 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.189423 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 20:28:16.190519 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.190502 2583 policy_none.go:47] "Start" Jun 05 20:28:16.221140 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221126 2583 manager.go:337] "Starting Device Plugin manager" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.221187 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221200 2583 server.go:87] "Starting device plugin registration server" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221444 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221455 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221612 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221697 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.221706 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.222237 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.222291 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.235680 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.236829 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.236861 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.236881 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.236911 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 20:28:16.242440 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.239198 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:16.321611 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.321569 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.322747 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.322729 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.322851 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.322760 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.322851 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.322771 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.324430 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.323044 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.329083 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.329066 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.329175 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.329089 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-23.ec2.internal\": node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.338216 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.337455 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal"] Jun 05 20:28:16.338216 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.338216 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.338992 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.338976 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.339065 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.339004 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.339065 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.339013 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.340339 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.340327 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.340431 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.340418 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.340468 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.340444 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.340986 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.340970 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.341057 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.341002 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.341057 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.341014 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.341117 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.340970 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.341117 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.341082 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.341117 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.341097 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.342220 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.342203 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.342298 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.342251 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 20:28:16.343324 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.343305 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.343474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.343458 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientMemory" Jun 05 20:28:16.343474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.343495 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 20:28:16.343673 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.343510 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeHasSufficientPID" Jun 05 20:28:16.358995 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.358978 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-23.ec2.internal\" not found" node="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.362882 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.362867 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-23.ec2.internal\" not found" node="ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.367705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.367686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24874d8ccd17d7eda0c345cccfabff1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"24874d8ccd17d7eda0c345cccfabff1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.367778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.367712 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.367778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.367729 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.444098 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.444065 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.468574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468543 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24874d8ccd17d7eda0c345cccfabff1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"24874d8ccd17d7eda0c345cccfabff1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.468665 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/24874d8ccd17d7eda0c345cccfabff1b-config\") pod \"kube-apiserver-proxy-ip-10-0-133-23.ec2.internal\" (UID: \"24874d8ccd17d7eda0c345cccfabff1b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.468665 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468607 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.468665 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.468772 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468675 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.468772 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.468696 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/882ccb3853144348251bcb3bfd27d062-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal\" (UID: \"882ccb3853144348251bcb3bfd27d062\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.544605 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.544555 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.645256 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.645183 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.663556 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.663534 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.667572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:16.667555 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:16.745549 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.745505 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.845979 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.845949 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:16.946453 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:16.946371 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:17.047005 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:17.046970 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:17.106454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.106417 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 20:28:17.107207 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.106573 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:28:17.107207 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.106581 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 20:28:17.147716 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:17.147687 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:17.166998 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.166956 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 20:23:16 +0000 UTC" deadline="2028-01-22 18:17:39.516069504 +0000 UTC" Jun 05 20:28:17.166998 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.166997 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14301h49m22.349078036s" Jun 05 20:28:17.239361 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:17.239328 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24874d8ccd17d7eda0c345cccfabff1b.slice/crio-52f94ac014095b762d3aaccb11226f2a0c1d66e34bff4db543bb5477040c00fe WatchSource:0}: Error finding container 52f94ac014095b762d3aaccb11226f2a0c1d66e34bff4db543bb5477040c00fe: Status 404 returned error can't find the container with id 52f94ac014095b762d3aaccb11226f2a0c1d66e34bff4db543bb5477040c00fe Jun 05 20:28:17.239681 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:17.239661 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882ccb3853144348251bcb3bfd27d062.slice/crio-1959fe967430b2a14ffea0459e63069b53ac4b9224b7c719af8da3a3b47d49a5 WatchSource:0}: Error finding container 1959fe967430b2a14ffea0459e63069b53ac4b9224b7c719af8da3a3b47d49a5: Status 404 returned error can't find the container with id 1959fe967430b2a14ffea0459e63069b53ac4b9224b7c719af8da3a3b47d49a5 Jun 05 20:28:17.243955 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.243938 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 20:28:17.248599 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:17.248580 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:17.349193 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:17.349164 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-23.ec2.internal\" not found" Jun 05 20:28:17.395029 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.395008 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:17.466930 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.466906 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" Jun 05 20:28:17.475825 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.475808 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:28:17.477773 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.477738 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" Jun 05 20:28:17.486907 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.486884 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 20:28:17.727592 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.727420 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:17.986001 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:17.985965 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:18.077369 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.077348 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 20:28:18.149365 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.149334 2583 apiserver.go:52] "Watching apiserver" Jun 05 20:28:18.155154 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.155128 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 20:28:18.155511 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.155474 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-f8dqn","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw","openshift-cluster-node-tuning-operator/tuned-z4jwz","openshift-dns/node-resolver-4jpnl","openshift-image-registry/node-ca-xns9l","openshift-multus/multus-additional-cni-plugins-vt5g9","openshift-multus/multus-xlrdn","kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal","openshift-multus/network-metrics-daemon-jlbxb","openshift-network-diagnostics/network-check-target-hp5s8","openshift-network-operator/iptables-alerter-n76t7","openshift-ovn-kubernetes/ovnkube-node-ptlgq","kube-system/global-pull-secret-syncer-jpbpg"] Jun 05 20:28:18.156999 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.156977 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.158677 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.158657 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.159785 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.159509 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 20:28:18.160002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.159984 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 20:28:18.161048 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.160273 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8qxv4\"" Jun 05 20:28:18.161048 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.160401 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.161048 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.160876 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.161221 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.161112 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.161221 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.161145 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lbq4r\"" Jun 05 20:28:18.161313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.161280 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.162669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.161887 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 20:28:18.162669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.162104 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.162669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.162168 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 20:28:18.162850 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.162762 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 20:28:18.163349 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.162969 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 20:28:18.163450 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.163388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.164587 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.164566 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.164674 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.164593 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.164674 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.164662 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrkbj\"" Jun 05 20:28:18.165324 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.165081 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.165324 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.165214 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.165914 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.165898 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 20:28:18.166447 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.166166 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tlv2m\"" Jun 05 20:28:18.166447 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.166166 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.166661 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.166649 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.167252 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.167143 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.167252 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.167159 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 20:28:18.167513 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.167494 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.167513 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.167508 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tbdlw\"" Jun 05 20:28:18.168188 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.168173 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.168315 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.168286 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:18.168406 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.168392 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 20:28:18.168555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.168533 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zp6hn\"" Jun 05 20:28:18.168654 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.168640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 20:28:18.169464 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.169446 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.170840 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.170824 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.171408 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.171383 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 20:28:18.171555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.171468 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 20:28:18.171555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.171501 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b7kd7\"" Jun 05 20:28:18.172357 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.172341 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.172580 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.172560 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:18.172907 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.172892 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 20:28:18.173101 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.173083 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.173179 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.173103 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5fzst\"" Jun 05 20:28:18.173179 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.173135 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.173764 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.173691 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:18.173823 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.173775 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:18.175036 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.175017 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.177213 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177186 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177221 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vkw9r\"" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177244 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-modprobe-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177270 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45349a0-f3a3-4247-9c3a-8f3274e82617-tmp-dir\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-netd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.177313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177308 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-kubernetes\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177322 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-sys\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177345 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-host\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-tmp\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177377 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-dbus\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177410 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-socket-dir-parent\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177422 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177425 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-kubelet\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177595 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-tuned\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.177620 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177618 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-host\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177640 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9nj\" (UniqueName: \"kubernetes.io/projected/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-kube-api-access-7w9nj\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177665 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-os-release\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177688 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-os-release\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177713 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-systemd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177747 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-cnibin\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177793 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-kubelet-config\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177817 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-hostroot\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177839 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-multus-daemon-config\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177878 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-kubelet\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177907 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-node-log\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177928 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-lib-modules\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177966 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwl29\" (UniqueName: \"kubernetes.io/projected/a45349a0-f3a3-4247-9c3a-8f3274e82617-kube-api-access-rwl29\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.177989 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-cni-binary-copy\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-netns\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178044 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-system-cni-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrkfj\" (UniqueName: \"kubernetes.io/projected/0e926585-1ea2-42af-9b66-ec370e88a915-kube-api-access-xrkfj\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178192 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-system-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178215 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-bin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178262 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krd5k\" (UniqueName: \"kubernetes.io/projected/aadebda0-926f-4223-8a6f-501a3a844aec-kube-api-access-krd5k\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-script-lib\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178311 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysconfig\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178331 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-serviceca\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178354 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178405 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-multus\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178434 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-var-lib-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178452 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-config\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178466 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50a0934b-701f-4309-8bfd-59c2a71ec836-ovn-node-metrics-cert\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-systemd\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.178831 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178574 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-etc-kubernetes\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178589 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-systemd-units\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178639 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-env-overrides\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqkzw\" (UniqueName: \"kubernetes.io/projected/50a0934b-701f-4309-8bfd-59c2a71ec836-kube-api-access-rqkzw\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178698 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tbfg\" (UniqueName: \"kubernetes.io/projected/9e2d01fe-37f2-49f5-82c6-0d005292c03d-kube-api-access-4tbfg\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178726 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178752 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-cnibin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178794 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-multus-certs\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178848 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-conf\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178887 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-run\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178920 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-var-lib-kubelet\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178943 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a45349a0-f3a3-4247-9c3a-8f3274e82617-hosts-file\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-slash\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.178985 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-ovn\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179077 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-netns\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179137 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-log-socket\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.179572 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-conf-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-bin\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179213 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179267 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-k8s-cni-cncf-io\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.180344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.179303 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-etc-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.180669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.180637 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 20:28:18.198148 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.198129 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7dsd" Jun 05 20:28:18.205251 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.204884 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-s7dsd" Jun 05 20:28:18.241621 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.241516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"882ccb3853144348251bcb3bfd27d062","Type":"ContainerStarted","Data":"1959fe967430b2a14ffea0459e63069b53ac4b9224b7c719af8da3a3b47d49a5"} Jun 05 20:28:18.242669 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.242638 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" event={"ID":"24874d8ccd17d7eda0c345cccfabff1b","Type":"ContainerStarted","Data":"52f94ac014095b762d3aaccb11226f2a0c1d66e34bff4db543bb5477040c00fe"} Jun 05 20:28:18.268132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.268106 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 20:28:18.279783 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279758 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-conf-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-bin\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279834 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279864 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-registration-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279893 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-conf-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.279949 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279933 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279935 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-bin\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279965 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.279994 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnp7f\" (UniqueName: \"kubernetes.io/projected/008bf6a0-27ba-4446-b8c8-838a15344737-kube-api-access-hnp7f\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-etc-selinux\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-k8s-cni-cncf-io\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280056 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-etc-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280080 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-sys-fs\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280086 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-k8s-cni-cncf-io\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280094 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280104 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-modprobe-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280107 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280133 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45349a0-f3a3-4247-9c3a-8f3274e82617-tmp-dir\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280137 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-etc-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280178 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-netd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280199 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-kubernetes\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-sys\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.280236 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280225 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-cni-netd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280229 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-modprobe-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280243 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-host\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280279 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-tmp\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280284 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-kubernetes\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280290 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-host\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-konnectivity-ca\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280326 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-sys\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280348 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-dbus\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-socket-dir-parent\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280394 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-kubelet\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280438 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a45349a0-f3a3-4247-9c3a-8f3274e82617-tmp-dir\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280462 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-tuned\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/008bf6a0-27ba-4446-b8c8-838a15344737-host-slash\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280755 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-host\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9nj\" (UniqueName: \"kubernetes.io/projected/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-kube-api-access-7w9nj\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280806 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-os-release\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.281077 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280834 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-os-release\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-systemd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280881 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280900 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-cnibin\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-kubelet-config\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-hostroot\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280530 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-socket-dir-parent\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280509 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-dbus\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280563 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280957 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-multus-daemon-config\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280582 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280994 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-os-release\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281004 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-kubelet\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281019 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-host\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281039 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-kubelet\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280593 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281037 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-systemd\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281051 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-os-release\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.281937 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281053 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-cnibin\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.280562 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-kubelet\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-node-log\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281093 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-kubelet-config\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281106 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-hostroot\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281110 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-lib-modules\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281133 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-ovn-kubernetes\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281154 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwl29\" (UniqueName: \"kubernetes.io/projected/a45349a0-f3a3-4247-9c3a-8f3274e82617-kube-api-access-rwl29\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281181 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-cni-binary-copy\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281185 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-node-log\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281183 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-lib-modules\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-netns\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-system-cni-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281380 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrkfj\" (UniqueName: \"kubernetes.io/projected/0e926585-1ea2-42af-9b66-ec370e88a915-kube-api-access-xrkfj\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281397 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-run-netns\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281404 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-system-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.282981 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281445 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-bin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281456 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e926585-1ea2-42af-9b66-ec370e88a915-system-cni-dir\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281470 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krd5k\" (UniqueName: \"kubernetes.io/projected/aadebda0-926f-4223-8a6f-501a3a844aec-kube-api-access-krd5k\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281648 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-system-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281681 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-multus-daemon-config\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281714 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-script-lib\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysconfig\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-serviceca\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281718 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-bin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281783 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-multus\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-var-lib-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281873 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-config\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281893 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50a0934b-701f-4309-8bfd-59c2a71ec836-ovn-node-metrics-cert\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-systemd\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281972 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndqr6\" (UniqueName: \"kubernetes.io/projected/d68e2a6e-118c-49fa-b506-930b8c693e4a-kube-api-access-ndqr6\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.283801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.281997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282033 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-etc-kubernetes\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282067 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-systemd-units\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-env-overrides\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqkzw\" (UniqueName: \"kubernetes.io/projected/50a0934b-701f-4309-8bfd-59c2a71ec836-kube-api-access-rqkzw\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282137 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tbfg\" (UniqueName: \"kubernetes.io/projected/9e2d01fe-37f2-49f5-82c6-0d005292c03d-kube-api-access-4tbfg\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282162 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282189 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-cnibin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282233 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e926585-1ea2-42af-9b66-ec370e88a915-cni-binary-copy\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282246 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-systemd-units\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-multus-certs\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282259 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aadebda0-926f-4223-8a6f-501a3a844aec-cni-binary-copy\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282314 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-conf\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282341 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-run\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282354 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysconfig\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282361 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-multus-cni-dir\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282280 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-multus-certs\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.284396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282316 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-systemd\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282364 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-var-lib-kubelet\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282317 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-etc-kubernetes\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282408 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-var-lib-cni-multus\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282497 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-var-lib-kubelet\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282542 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a45349a0-f3a3-4247-9c3a-8f3274e82617-hosts-file\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282598 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-slash\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-ovn\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282649 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282714 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/008bf6a0-27ba-4446-b8c8-838a15344737-iptables-alerter-script\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282749 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-env-overrides\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282773 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-agent-certs\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282798 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-socket-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282817 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-cnibin\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282824 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-netns\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.282842 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-log-socket\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285135 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282840 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-serviceca\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282894 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-script-lib\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.282925 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:18.782903785 +0000 UTC m=+3.020571101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282944 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-conf\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282947 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-log-socket\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282949 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-run\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282960 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-device-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.282988 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a45349a0-f3a3-4247-9c3a-8f3274e82617-hosts-file\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283019 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-host-slash\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283013 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dc8c\" (UniqueName: \"kubernetes.io/projected/46e048f0-d77e-43fe-b5f1-0b78670c61db-kube-api-access-4dc8c\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283084 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-var-lib-openvswitch\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283123 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50a0934b-701f-4309-8bfd-59c2a71ec836-run-ovn\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283157 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-sysctl-d\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283252 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/aadebda0-926f-4223-8a6f-501a3a844aec-host-run-netns\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.283402 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50a0934b-701f-4309-8bfd-59c2a71ec836-ovnkube-config\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.284738 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-tmp\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.284755 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/9e2d01fe-37f2-49f5-82c6-0d005292c03d-etc-tuned\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.285786 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.285372 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50a0934b-701f-4309-8bfd-59c2a71ec836-ovn-node-metrics-cert\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.290003 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.289977 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krd5k\" (UniqueName: \"kubernetes.io/projected/aadebda0-926f-4223-8a6f-501a3a844aec-kube-api-access-krd5k\") pod \"multus-xlrdn\" (UID: \"aadebda0-926f-4223-8a6f-501a3a844aec\") " pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.290109 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.290076 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrkfj\" (UniqueName: \"kubernetes.io/projected/0e926585-1ea2-42af-9b66-ec370e88a915-kube-api-access-xrkfj\") pod \"multus-additional-cni-plugins-vt5g9\" (UID: \"0e926585-1ea2-42af-9b66-ec370e88a915\") " pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.290554 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.290494 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9nj\" (UniqueName: \"kubernetes.io/projected/42b491bf-f1e3-437f-bb57-0dcf8c59e06e-kube-api-access-7w9nj\") pod \"node-ca-xns9l\" (UID: \"42b491bf-f1e3-437f-bb57-0dcf8c59e06e\") " pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.290692 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.290670 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqkzw\" (UniqueName: \"kubernetes.io/projected/50a0934b-701f-4309-8bfd-59c2a71ec836-kube-api-access-rqkzw\") pod \"ovnkube-node-ptlgq\" (UID: \"50a0934b-701f-4309-8bfd-59c2a71ec836\") " pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.290856 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.290678 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwl29\" (UniqueName: \"kubernetes.io/projected/a45349a0-f3a3-4247-9c3a-8f3274e82617-kube-api-access-rwl29\") pod \"node-resolver-4jpnl\" (UID: \"a45349a0-f3a3-4247-9c3a-8f3274e82617\") " pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.291406 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.291387 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tbfg\" (UniqueName: \"kubernetes.io/projected/9e2d01fe-37f2-49f5-82c6-0d005292c03d-kube-api-access-4tbfg\") pod \"tuned-z4jwz\" (UID: \"9e2d01fe-37f2-49f5-82c6-0d005292c03d\") " pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.384314 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/008bf6a0-27ba-4446-b8c8-838a15344737-host-slash\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.384454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndqr6\" (UniqueName: \"kubernetes.io/projected/d68e2a6e-118c-49fa-b506-930b8c693e4a-kube-api-access-ndqr6\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.384454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384370 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:18.384454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384342 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/008bf6a0-27ba-4446-b8c8-838a15344737-host-slash\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.384454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384410 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/008bf6a0-27ba-4446-b8c8-838a15344737-iptables-alerter-script\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384554 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-agent-certs\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.384559 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384579 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-socket-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384601 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-device-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dc8c\" (UniqueName: \"kubernetes.io/projected/46e048f0-d77e-43fe-b5f1-0b78670c61db-kube-api-access-4dc8c\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.384660 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:18.884638008 +0000 UTC m=+3.122305312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:18.384694 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384685 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384718 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-registration-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384750 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnp7f\" (UniqueName: \"kubernetes.io/projected/008bf6a0-27ba-4446-b8c8-838a15344737-kube-api-access-hnp7f\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384762 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-socket-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-etc-selinux\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384791 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-sys-fs\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-konnectivity-ca\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384872 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-registration-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384749 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-device-dir\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384946 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-sys-fs\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.384997 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/46e048f0-d77e-43fe-b5f1-0b78670c61db-etc-selinux\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.385466 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.385155 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/008bf6a0-27ba-4446-b8c8-838a15344737-iptables-alerter-script\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.385466 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.385431 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-konnectivity-ca\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.386889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.386871 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0a4df144-31a2-45b4-8bbd-fa845f20c9ac-agent-certs\") pod \"konnectivity-agent-f8dqn\" (UID: \"0a4df144-31a2-45b4-8bbd-fa845f20c9ac\") " pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.391581 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.391559 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:18.391705 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.391586 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:18.391705 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.391603 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:18.391705 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.391666 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:18.891650279 +0000 UTC m=+3.129317593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:18.393720 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.393673 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnp7f\" (UniqueName: \"kubernetes.io/projected/008bf6a0-27ba-4446-b8c8-838a15344737-kube-api-access-hnp7f\") pod \"iptables-alerter-n76t7\" (UID: \"008bf6a0-27ba-4446-b8c8-838a15344737\") " pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.394422 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.394382 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndqr6\" (UniqueName: \"kubernetes.io/projected/d68e2a6e-118c-49fa-b506-930b8c693e4a-kube-api-access-ndqr6\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.394631 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.394608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dc8c\" (UniqueName: \"kubernetes.io/projected/46e048f0-d77e-43fe-b5f1-0b78670c61db-kube-api-access-4dc8c\") pod \"aws-ebs-csi-driver-node-xw9rw\" (UID: \"46e048f0-d77e-43fe-b5f1-0b78670c61db\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.469598 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.469562 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xlrdn" Jun 05 20:28:18.477455 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.477431 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:18.486243 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.486217 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" Jun 05 20:28:18.490761 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.490742 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4jpnl" Jun 05 20:28:18.497858 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.497836 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xns9l" Jun 05 20:28:18.504458 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.504439 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" Jun 05 20:28:18.511713 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.511693 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:18.518187 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.518162 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" Jun 05 20:28:18.523775 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.523751 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n76t7" Jun 05 20:28:18.786976 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.786898 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:18.787123 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.787022 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:18.787123 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.787075 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:19.787060577 +0000 UTC m=+4.024727870 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:18.887777 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.887742 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:18.887926 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.887853 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:18.887926 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.887908 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:19.887889082 +0000 UTC m=+4.125556396 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:18.988014 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:18.987987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:18.988181 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.988156 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:18.988181 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.988182 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:18.988286 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.988196 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:18.988286 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:18.988261 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:19.988241423 +0000 UTC m=+4.225908737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:19.006426 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.006405 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e048f0_d77e_43fe_b5f1_0b78670c61db.slice/crio-3db6d1833e0e3aacdceb21c2a6dff54baac2a9d491826bc96ec96a7f855ac24f WatchSource:0}: Error finding container 3db6d1833e0e3aacdceb21c2a6dff54baac2a9d491826bc96ec96a7f855ac24f: Status 404 returned error can't find the container with id 3db6d1833e0e3aacdceb21c2a6dff54baac2a9d491826bc96ec96a7f855ac24f Jun 05 20:28:19.007595 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.007570 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda45349a0_f3a3_4247_9c3a_8f3274e82617.slice/crio-41997f90696a5b1a02f6c6a7c00ab13ca5fe142ed50702df346c8f644667a03a WatchSource:0}: Error finding container 41997f90696a5b1a02f6c6a7c00ab13ca5fe142ed50702df346c8f644667a03a: Status 404 returned error can't find the container with id 41997f90696a5b1a02f6c6a7c00ab13ca5fe142ed50702df346c8f644667a03a Jun 05 20:28:19.009234 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.009177 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaadebda0_926f_4223_8a6f_501a3a844aec.slice/crio-750c12d00392aa952507270741623b7cd1c8ab38dad645b644eb5fdc0b6c5d35 WatchSource:0}: Error finding container 750c12d00392aa952507270741623b7cd1c8ab38dad645b644eb5fdc0b6c5d35: Status 404 returned error can't find the container with id 750c12d00392aa952507270741623b7cd1c8ab38dad645b644eb5fdc0b6c5d35 Jun 05 20:28:19.011556 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.011529 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2d01fe_37f2_49f5_82c6_0d005292c03d.slice/crio-09af51a4266aa8117c78b12027de9477818d4a54821bbdec0f120990b2711901 WatchSource:0}: Error finding container 09af51a4266aa8117c78b12027de9477818d4a54821bbdec0f120990b2711901: Status 404 returned error can't find the container with id 09af51a4266aa8117c78b12027de9477818d4a54821bbdec0f120990b2711901 Jun 05 20:28:19.012579 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.012543 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod008bf6a0_27ba_4446_b8c8_838a15344737.slice/crio-87c7e98034524af93ead249bc7e8463139dd3a5ff94bb5d5dd2a307962f7e676 WatchSource:0}: Error finding container 87c7e98034524af93ead249bc7e8463139dd3a5ff94bb5d5dd2a307962f7e676: Status 404 returned error can't find the container with id 87c7e98034524af93ead249bc7e8463139dd3a5ff94bb5d5dd2a307962f7e676 Jun 05 20:28:19.014710 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.014674 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42b491bf_f1e3_437f_bb57_0dcf8c59e06e.slice/crio-af54787aa92ebe361c4c6736347f7f3b6d10e78039672604da5e58fb6f5e4e6d WatchSource:0}: Error finding container af54787aa92ebe361c4c6736347f7f3b6d10e78039672604da5e58fb6f5e4e6d: Status 404 returned error can't find the container with id af54787aa92ebe361c4c6736347f7f3b6d10e78039672604da5e58fb6f5e4e6d Jun 05 20:28:19.015345 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.015328 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e926585_1ea2_42af_9b66_ec370e88a915.slice/crio-f5f16feceb80348cf464d572dcaf13098289d33dd4f27b1077e13679164a05c2 WatchSource:0}: Error finding container f5f16feceb80348cf464d572dcaf13098289d33dd4f27b1077e13679164a05c2: Status 404 returned error can't find the container with id f5f16feceb80348cf464d572dcaf13098289d33dd4f27b1077e13679164a05c2 Jun 05 20:28:19.016770 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.016746 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50a0934b_701f_4309_8bfd_59c2a71ec836.slice/crio-6128ab285a6fd581b8b4f0297bd9028771d1cc2f00ee7896cdf4f36c53e33652 WatchSource:0}: Error finding container 6128ab285a6fd581b8b4f0297bd9028771d1cc2f00ee7896cdf4f36c53e33652: Status 404 returned error can't find the container with id 6128ab285a6fd581b8b4f0297bd9028771d1cc2f00ee7896cdf4f36c53e33652 Jun 05 20:28:19.018288 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:19.018268 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4df144_31a2_45b4_8bbd_fa845f20c9ac.slice/crio-8e54035bf6ad32a1a5287f9a635d27b9178b0791513da9db0644eabdf712e520 WatchSource:0}: Error finding container 8e54035bf6ad32a1a5287f9a635d27b9178b0791513da9db0644eabdf712e520: Status 404 returned error can't find the container with id 8e54035bf6ad32a1a5287f9a635d27b9178b0791513da9db0644eabdf712e520 Jun 05 20:28:19.207315 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.207277 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:23:18 +0000 UTC" deadline="2028-03-07 16:40:41.987848312 +0000 UTC" Jun 05 20:28:19.207315 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.207312 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15380h12m22.780540567s" Jun 05 20:28:19.247740 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.247714 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerStarted","Data":"f5f16feceb80348cf464d572dcaf13098289d33dd4f27b1077e13679164a05c2"} Jun 05 20:28:19.248713 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.248695 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlrdn" event={"ID":"aadebda0-926f-4223-8a6f-501a3a844aec","Type":"ContainerStarted","Data":"750c12d00392aa952507270741623b7cd1c8ab38dad645b644eb5fdc0b6c5d35"} Jun 05 20:28:19.249727 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.249701 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jpnl" event={"ID":"a45349a0-f3a3-4247-9c3a-8f3274e82617","Type":"ContainerStarted","Data":"41997f90696a5b1a02f6c6a7c00ab13ca5fe142ed50702df346c8f644667a03a"} Jun 05 20:28:19.250668 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.250646 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" event={"ID":"46e048f0-d77e-43fe-b5f1-0b78670c61db","Type":"ContainerStarted","Data":"3db6d1833e0e3aacdceb21c2a6dff54baac2a9d491826bc96ec96a7f855ac24f"} Jun 05 20:28:19.251663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.251629 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xns9l" event={"ID":"42b491bf-f1e3-437f-bb57-0dcf8c59e06e","Type":"ContainerStarted","Data":"af54787aa92ebe361c4c6736347f7f3b6d10e78039672604da5e58fb6f5e4e6d"} Jun 05 20:28:19.252616 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.252598 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n76t7" event={"ID":"008bf6a0-27ba-4446-b8c8-838a15344737","Type":"ContainerStarted","Data":"87c7e98034524af93ead249bc7e8463139dd3a5ff94bb5d5dd2a307962f7e676"} Jun 05 20:28:19.253648 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.253628 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" event={"ID":"9e2d01fe-37f2-49f5-82c6-0d005292c03d","Type":"ContainerStarted","Data":"09af51a4266aa8117c78b12027de9477818d4a54821bbdec0f120990b2711901"} Jun 05 20:28:19.255320 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.255300 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" event={"ID":"24874d8ccd17d7eda0c345cccfabff1b","Type":"ContainerStarted","Data":"34bf6aaf1a5ee22f3da2f00f3765e30d7daa8eed7e82ec20a1be4072d37e9972"} Jun 05 20:28:19.256405 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.256382 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8dqn" event={"ID":"0a4df144-31a2-45b4-8bbd-fa845f20c9ac","Type":"ContainerStarted","Data":"8e54035bf6ad32a1a5287f9a635d27b9178b0791513da9db0644eabdf712e520"} Jun 05 20:28:19.257529 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.257506 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"6128ab285a6fd581b8b4f0297bd9028771d1cc2f00ee7896cdf4f36c53e33652"} Jun 05 20:28:19.799824 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.799790 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:19.800006 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:19.799917 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:19.800006 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:19.799977 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:21.799958392 +0000 UTC m=+6.037625705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:19.900633 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:19.900595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:19.900798 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:19.900759 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:19.900909 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:19.900832 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:21.900810527 +0000 UTC m=+6.138477834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:20.001988 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.001948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:20.002167 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.002144 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:20.002167 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.002161 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:20.002270 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.002174 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:20.002322 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.002314 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:22.002273571 +0000 UTC m=+6.239940878 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:20.208523 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.208378 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 20:23:18 +0000 UTC" deadline="2027-11-11 23:19:30.488555814 +0000 UTC" Jun 05 20:28:20.208523 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.208436 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12578h51m10.280123734s" Jun 05 20:28:20.237857 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.237827 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:20.238019 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.237958 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:20.238387 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.238367 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:20.238537 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.238517 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:20.238640 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.238623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:20.238752 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:20.238693 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:20.272759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.272727 2583 generic.go:356] "Generic (PLEG): container finished" podID="882ccb3853144348251bcb3bfd27d062" containerID="85875a681b5a8cc3c554aed53f6acd9d50b4ae59e86ea549a5ee3e84768ac7aa" exitCode=0 Jun 05 20:28:20.273845 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.273537 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"882ccb3853144348251bcb3bfd27d062","Type":"ContainerDied","Data":"85875a681b5a8cc3c554aed53f6acd9d50b4ae59e86ea549a5ee3e84768ac7aa"} Jun 05 20:28:20.290204 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:20.290120 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-23.ec2.internal" podStartSLOduration=3.290098521 podStartE2EDuration="3.290098521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:19.269097028 +0000 UTC m=+3.506764344" watchObservedRunningTime="2026-06-05 20:28:20.290098521 +0000 UTC m=+4.527765837" Jun 05 20:28:21.294742 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:21.294688 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" event={"ID":"882ccb3853144348251bcb3bfd27d062","Type":"ContainerStarted","Data":"8335233c8f634f4867fcee72e3718767d37641067354ee20e7ba7d3fa2474634"} Jun 05 20:28:21.817796 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:21.817432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:21.829114 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:21.829084 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:21.829904 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:21.829442 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:25.829413744 +0000 UTC m=+10.067081052 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:21.919524 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:21.918977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:21.919524 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:21.919112 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:21.919524 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:21.919176 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:25.919157334 +0000 UTC m=+10.156824633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:22.020830 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:22.020112 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:22.020830 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.020290 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:22.020830 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.020313 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:22.020830 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.020326 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:22.020830 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.020387 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:26.020367432 +0000 UTC m=+10.258034743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:22.237896 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.238030 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:22.238426 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.238560 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:22.238702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:22.239633 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:22.238806 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:24.237453 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:24.237194 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:24.237453 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:24.237326 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:24.237453 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:24.237346 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:24.238003 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:24.237451 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:24.238003 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:24.237564 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:24.238003 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:24.237657 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:25.852278 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:25.852235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:25.852715 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:25.852401 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:25.852715 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:25.852463 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:33.852444195 +0000 UTC m=+18.090111504 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:25.953344 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:25.953309 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:25.953575 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:25.953464 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:25.953575 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:25.953540 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:33.953519872 +0000 UTC m=+18.191187168 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:26.054692 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:26.054636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:26.057764 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.055552 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:26.057764 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.055592 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:26.057764 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.055609 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:26.057764 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.055690 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:34.055670457 +0000 UTC m=+18.293337753 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:26.238744 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:26.238661 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:26.239132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:26.238960 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:26.239132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:26.238995 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:26.239706 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.239359 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:26.239706 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.239454 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:26.239706 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:26.239578 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:28.237454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:28.237347 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:28.237454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:28.237386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:28.237983 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:28.237477 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:28.237983 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:28.237350 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:28.237983 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:28.237615 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:28.237983 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:28.237706 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:30.237351 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:30.237313 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:30.237351 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:30.237337 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:30.237351 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:30.237351 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:30.237911 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:30.237455 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:30.237911 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:30.237585 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:30.237911 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:30.237690 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:32.238059 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:32.238029 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:32.238059 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:32.238041 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:32.238600 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:32.238087 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:32.238600 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:32.238194 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:32.238600 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:32.238265 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:32.238600 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:32.238356 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:33.916331 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:33.916295 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:33.916774 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:33.916452 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:33.916774 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:33.916536 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:28:49.916516479 +0000 UTC m=+34.154183777 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:34.017718 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:34.017669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:34.017890 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.017831 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:34.017966 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.017914 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:28:50.017890862 +0000 UTC m=+34.255558188 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:34.118535 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:34.118436 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:34.118693 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.118611 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:34.118693 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.118638 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:34.118693 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.118654 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:34.118830 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.118734 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:50.118720147 +0000 UTC m=+34.356387445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:34.237859 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:34.237821 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:34.238034 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:34.237834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:34.238034 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.237954 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:34.238034 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:34.237839 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:34.238193 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.238007 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:34.238193 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:34.238149 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:36.238340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:36.238115 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:36.238819 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:36.238187 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:36.238819 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:36.238417 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:36.238819 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:36.238223 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:36.238819 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:36.238512 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:36.238819 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:36.238581 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:38.237913 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.237703 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:38.238463 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.237703 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:38.238463 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:38.237944 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:38.238463 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.237749 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:38.238463 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:38.238038 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:38.238463 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:38.238093 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:38.328957 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.328927 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" event={"ID":"46e048f0-d77e-43fe-b5f1-0b78670c61db","Type":"ContainerStarted","Data":"02d091d7da7e409c621fd2dff716f76f5aa569d25d4d5ef97c2a1748a6a06da5"} Jun 05 20:28:38.330434 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.330405 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xns9l" event={"ID":"42b491bf-f1e3-437f-bb57-0dcf8c59e06e","Type":"ContainerStarted","Data":"5f8e88266cd689838c7d980461b0350723f0ae12915a9d2dc3789def732aa723"} Jun 05 20:28:38.332059 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.332036 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" event={"ID":"9e2d01fe-37f2-49f5-82c6-0d005292c03d","Type":"ContainerStarted","Data":"2a12cf864da3b26b90190cbbf54c5fecc9a9cbd92361b6d8328a980dd224afe0"} Jun 05 20:28:38.333510 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.333447 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f8dqn" event={"ID":"0a4df144-31a2-45b4-8bbd-fa845f20c9ac","Type":"ContainerStarted","Data":"b156d194e339f27eaf3338573edd91ea4ed1a5a26b65005f2922b346b08482ec"} Jun 05 20:28:38.337297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.337035 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"4a69f17a2fc3dca6ee82bc3e52f0f18b840cac96a5bfa2c9dbab5afc077c71a5"} Jun 05 20:28:38.337297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.337111 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"3ed8a211372a7fb9bfdee853069af86f4f920342c6d721b715bd4f67f500f365"} Jun 05 20:28:38.337297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.337155 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"076a63073d04cb643965d907d154e81d95c3972076f4f06197fd0291ae835918"} Jun 05 20:28:38.337297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.337197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"095a90ebb8aaa153f5245894c882e3d002c7fb4cad245ac91a9d502555ded03a"} Jun 05 20:28:38.337297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.337237 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"f173d22e6e91857d1c49f8072d92679cd2583b72d2c6708162004ce5f269ab60"} Jun 05 20:28:38.339910 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.339883 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="3bd10b3d4d2a9bf1a397aceaed2e75951089472eefab0622bddc3a8fb417e724" exitCode=0 Jun 05 20:28:38.339993 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.339961 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"3bd10b3d4d2a9bf1a397aceaed2e75951089472eefab0622bddc3a8fb417e724"} Jun 05 20:28:38.341746 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.341722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xlrdn" event={"ID":"aadebda0-926f-4223-8a6f-501a3a844aec","Type":"ContainerStarted","Data":"65365d5cd24b3ee500cff727620d154dfaa20328ab7aa46cb35525c2b3dbfa68"} Jun 05 20:28:38.343262 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.343244 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4jpnl" event={"ID":"a45349a0-f3a3-4247-9c3a-8f3274e82617","Type":"ContainerStarted","Data":"b656ef44028e1d29ac415e999861030185e512b4eb245e95feab2a95f60a1481"} Jun 05 20:28:38.346571 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.346526 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xns9l" podStartSLOduration=3.616135732 podStartE2EDuration="22.34651417s" totalImagesPullingTime="18.730378438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:38.346137436 +0000 UTC m=+22.583804752" watchObservedRunningTime="2026-06-05 20:28:38.34651417 +0000 UTC m=+22.584181485" Jun 05 20:28:38.346804 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.346780 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-23.ec2.internal" podStartSLOduration=21.346773918 podStartE2EDuration="21.346773918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:21.311797403 +0000 UTC m=+5.549464719" watchObservedRunningTime="2026-06-05 20:28:38.346773918 +0000 UTC m=+22.584441232" Jun 05 20:28:38.363987 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.363944 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-z4jwz" podStartSLOduration=3.617238989 podStartE2EDuration="22.363925475s" totalImagesPullingTime="18.746686486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:38.363525718 +0000 UTC m=+22.601193032" watchObservedRunningTime="2026-06-05 20:28:38.363925475 +0000 UTC m=+22.601592793" Jun 05 20:28:38.378388 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.378353 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f8dqn" podStartSLOduration=7.569066967 podStartE2EDuration="22.378340896s" totalImagesPullingTime="14.809273929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:38.377881889 +0000 UTC m=+22.615549204" watchObservedRunningTime="2026-06-05 20:28:38.378340896 +0000 UTC m=+22.616008242" Jun 05 20:28:38.416979 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.416918 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4jpnl" podStartSLOduration=3.677997813 podStartE2EDuration="22.416898192s" totalImagesPullingTime="18.738900379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:38.416733145 +0000 UTC m=+22.654400459" watchObservedRunningTime="2026-06-05 20:28:38.416898192 +0000 UTC m=+22.654565511" Jun 05 20:28:38.432256 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:38.432216 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xlrdn" podStartSLOduration=3.641164185 podStartE2EDuration="22.432205147s" totalImagesPullingTime="18.791040962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:38.43172795 +0000 UTC m=+22.669395270" watchObservedRunningTime="2026-06-05 20:28:38.432205147 +0000 UTC m=+22.669872469" Jun 05 20:28:39.236838 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:39.236660 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 20:28:39.348969 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:39.348897 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"474a6edf745e3ac9d476d6c2e7e07c210a2e27be0f94e9b538f2a913af6d0dfb"} Jun 05 20:28:39.350873 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:39.350846 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" event={"ID":"46e048f0-d77e-43fe-b5f1-0b78670c61db","Type":"ContainerStarted","Data":"dfca0c2b57a30323b33b72ac1737b999e6642d3af0f6d97881959f4298f21f54"} Jun 05 20:28:39.352523 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:39.352494 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n76t7" event={"ID":"008bf6a0-27ba-4446-b8c8-838a15344737","Type":"ContainerStarted","Data":"988ebe95646339fbc2e77c419dada3a332c2b410974f4df4cf373c1ae1f048ef"} Jun 05 20:28:40.234795 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.234716 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T20:28:39.236833165Z","UUID":"d2f0c165-d70f-48db-8b9c-1c263b33a119","Handler":null,"Name":"","Endpoint":""} Jun 05 20:28:40.236329 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.236309 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 20:28:40.236433 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.236353 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 20:28:40.237430 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.237163 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:40.237430 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.237172 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:40.237430 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:40.237277 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:40.237430 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:40.237364 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:40.237430 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.237398 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:40.237762 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:40.237448 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:40.357602 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.357567 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" event={"ID":"46e048f0-d77e-43fe-b5f1-0b78670c61db","Type":"ContainerStarted","Data":"681e7add26a7b93d7deeb10c656c8b9bd2452811792129eab3fc6995feef8e07"} Jun 05 20:28:40.375208 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.375165 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n76t7" podStartSLOduration=5.642776711 podStartE2EDuration="24.375143949s" totalImagesPullingTime="18.732367238s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:39.366451798 +0000 UTC m=+23.604119115" watchObservedRunningTime="2026-06-05 20:28:40.375143949 +0000 UTC m=+24.612811265" Jun 05 20:28:40.375458 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:40.375429 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xw9rw" podStartSLOduration=3.635783215 podStartE2EDuration="24.37542117s" totalImagesPullingTime="20.739637955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:40.374849424 +0000 UTC m=+24.612516739" watchObservedRunningTime="2026-06-05 20:28:40.37542117 +0000 UTC m=+24.613088485" Jun 05 20:28:41.363900 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:41.363860 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"534f92712217f3ad543aa1e8f93742251111907e7b59e8b3aa19ab4c9a28505c"} Jun 05 20:28:42.237700 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:42.237670 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:42.237898 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:42.237675 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:42.237898 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:42.237804 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:42.237898 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:42.237850 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:42.237898 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:42.237679 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:42.238121 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:42.237951 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:42.599717 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:42.599642 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:42.600340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:42.600323 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:43.371318 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.371280 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" event={"ID":"50a0934b-701f-4309-8bfd-59c2a71ec836","Type":"ContainerStarted","Data":"9266e17659eadc52cae186517d57d1f1622f0c508bd7936980a605e2665292e7"} Jun 05 20:28:43.371629 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.371606 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:43.371719 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.371679 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:43.371755 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.371727 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:43.373441 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.373411 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="17086516ad3d2cb8dbcfcf44c58a35024372f9646a09cc9c391f5e40f0ff3662" exitCode=0 Jun 05 20:28:43.373584 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.373468 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"17086516ad3d2cb8dbcfcf44c58a35024372f9646a09cc9c391f5e40f0ff3662"} Jun 05 20:28:43.373770 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.373755 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:43.374237 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.374221 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f8dqn" Jun 05 20:28:43.387555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.387534 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:43.387665 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.387625 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:28:43.424341 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:43.424299 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" podStartSLOduration=8.62034241 podStartE2EDuration="27.424285888s" totalImagesPullingTime="18.803943478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:43.399151954 +0000 UTC m=+27.636819298" watchObservedRunningTime="2026-06-05 20:28:43.424285888 +0000 UTC m=+27.661953241" Jun 05 20:28:44.238189 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:44.238118 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:44.238189 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:44.238139 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:44.238714 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:44.238220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:44.238714 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:44.238233 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:44.238714 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:44.238295 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:44.238714 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:44.238376 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:45.032551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.032319 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jlbxb"] Jun 05 20:28:45.032821 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.032577 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:45.032821 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:45.032666 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:45.035023 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.034996 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hp5s8"] Jun 05 20:28:45.035146 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.035080 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:45.035212 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:45.035164 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:45.035827 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.035796 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpbpg"] Jun 05 20:28:45.035939 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.035893 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:45.035998 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:45.035979 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:45.379380 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.379310 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="bdf20a2444d6f4d2e46edef8b1083ebd22abf8f6f0e8188e165cf659c96d793e" exitCode=0 Jun 05 20:28:45.379970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:45.379391 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"bdf20a2444d6f4d2e46edef8b1083ebd22abf8f6f0e8188e165cf659c96d793e"} Jun 05 20:28:47.237382 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:47.237309 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:47.237382 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:47.237326 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:47.237382 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:47.237343 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:47.237978 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:47.237431 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:47.237978 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:47.237551 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:47.237978 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:47.237656 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:47.386595 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:47.386557 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="b451d052df7a550082e37bf15811697cd39a4a4a9023f66183f1db0ba56c6a1b" exitCode=0 Jun 05 20:28:47.386757 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:47.386609 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"b451d052df7a550082e37bf15811697cd39a4a4a9023f66183f1db0ba56c6a1b"} Jun 05 20:28:49.237680 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:49.237643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:49.237680 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:49.237675 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:49.238351 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:49.237675 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:49.238351 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:49.237784 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:49.238351 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:49.237905 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:49.238351 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:49.237972 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:49.949739 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:49.949706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:49.949931 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:49.949832 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:49.949931 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:49.949895 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret podName:7f5319b7-1b84-4521-87c1-2cb5acb0b70b nodeName:}" failed. No retries permitted until 2026-06-05 20:29:21.949877534 +0000 UTC m=+66.187544846 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret") pod "global-pull-secret-syncer-jpbpg" (UID: "7f5319b7-1b84-4521-87c1-2cb5acb0b70b") : object "kube-system"/"original-pull-secret" not registered Jun 05 20:28:50.051018 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:50.050987 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:50.051239 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.051116 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:50.051239 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.051196 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:29:22.05117545 +0000 UTC m=+66.288842761 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 20:28:50.151561 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:50.151522 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:50.151750 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.151725 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 20:28:50.151811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.151756 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 20:28:50.151811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.151770 2583 projected.go:196] Error preparing data for projected volume kube-api-access-jx6kz for pod openshift-network-diagnostics/network-check-target-hp5s8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:50.151908 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:50.151842 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz podName:8744dc21-1c18-4c48-b085-bfe36b22d704 nodeName:}" failed. No retries permitted until 2026-06-05 20:29:22.151818854 +0000 UTC m=+66.389486191 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jx6kz" (UniqueName: "kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz") pod "network-check-target-hp5s8" (UID: "8744dc21-1c18-4c48-b085-bfe36b22d704") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 20:28:51.237829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.237793 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:51.238297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.237930 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:51.238297 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:51.237932 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hp5s8" podUID="8744dc21-1c18-4c48-b085-bfe36b22d704" Jun 05 20:28:51.238297 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:51.238058 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:28:51.238297 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.238090 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:51.238297 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:51.238162 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jpbpg" podUID="7f5319b7-1b84-4521-87c1-2cb5acb0b70b" Jun 05 20:28:51.527559 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.527328 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-23.ec2.internal" event="NodeReady" Jun 05 20:28:51.527709 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.527640 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 20:28:51.568970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.568938 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pm5ml"] Jun 05 20:28:51.590973 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.590945 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9gdxv"] Jun 05 20:28:51.591129 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.591099 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.593378 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.593354 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 20:28:51.593534 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.593428 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 20:28:51.593534 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.593440 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-svhzf\"" Jun 05 20:28:51.605030 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.605012 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pm5ml"] Jun 05 20:28:51.605153 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.605043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gdxv"] Jun 05 20:28:51.605153 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.605118 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.607588 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.607568 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 20:28:51.607704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.607601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 20:28:51.607704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.607672 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-66z4j\"" Jun 05 20:28:51.607704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.607698 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 20:28:51.766060 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766032 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733405a4-43d0-4c67-a74c-2667f29c3fb7-config-volume\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.766160 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766135 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwn2f\" (UniqueName: \"kubernetes.io/projected/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-kube-api-access-vwn2f\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.766231 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766207 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mztc5\" (UniqueName: \"kubernetes.io/projected/733405a4-43d0-4c67-a74c-2667f29c3fb7-kube-api-access-mztc5\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.766269 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766256 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.766312 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766286 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733405a4-43d0-4c67-a74c-2667f29c3fb7-tmp-dir\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.766356 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.766324 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-cert\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.867106 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867081 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-cert\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.867230 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867138 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733405a4-43d0-4c67-a74c-2667f29c3fb7-config-volume\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.867230 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867183 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwn2f\" (UniqueName: \"kubernetes.io/projected/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-kube-api-access-vwn2f\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.867230 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867204 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mztc5\" (UniqueName: \"kubernetes.io/projected/733405a4-43d0-4c67-a74c-2667f29c3fb7-kube-api-access-mztc5\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.867230 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867224 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.867400 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733405a4-43d0-4c67-a74c-2667f29c3fb7-tmp-dir\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.867400 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:51.867389 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:28:51.867545 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:51.867471 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:52.367447717 +0000 UTC m=+36.605115027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:28:51.867545 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867533 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/733405a4-43d0-4c67-a74c-2667f29c3fb7-tmp-dir\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.867704 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.867684 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/733405a4-43d0-4c67-a74c-2667f29c3fb7-config-volume\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.870945 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.870929 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-cert\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.874597 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.874578 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mztc5\" (UniqueName: \"kubernetes.io/projected/733405a4-43d0-4c67-a74c-2667f29c3fb7-kube-api-access-mztc5\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:51.874674 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.874655 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwn2f\" (UniqueName: \"kubernetes.io/projected/7a2affb5-e23f-4b37-b6ba-ec2f75b21005-kube-api-access-vwn2f\") pod \"ingress-canary-9gdxv\" (UID: \"7a2affb5-e23f-4b37-b6ba-ec2f75b21005\") " pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:51.913129 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:51.913108 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9gdxv" Jun 05 20:28:52.042522 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:52.042473 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9gdxv"] Jun 05 20:28:52.046589 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:28:52.046558 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2affb5_e23f_4b37_b6ba_ec2f75b21005.slice/crio-1f64b26e2baaefa00af74c32ec36f467e884950d75e0361e5cfb7fe70c9f5050 WatchSource:0}: Error finding container 1f64b26e2baaefa00af74c32ec36f467e884950d75e0361e5cfb7fe70c9f5050: Status 404 returned error can't find the container with id 1f64b26e2baaefa00af74c32ec36f467e884950d75e0361e5cfb7fe70c9f5050 Jun 05 20:28:52.370417 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:52.370393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:52.370784 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:52.370503 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:28:52.370784 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:52.370567 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:53.370552925 +0000 UTC m=+37.608220218 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:28:52.400016 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:52.399984 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gdxv" event={"ID":"7a2affb5-e23f-4b37-b6ba-ec2f75b21005","Type":"ContainerStarted","Data":"1f64b26e2baaefa00af74c32ec36f467e884950d75e0361e5cfb7fe70c9f5050"} Jun 05 20:28:52.402379 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:52.402356 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="9d2318c942545677e3baac730ad8a05073a774c3b7089332f86963acb1c8b11e" exitCode=0 Jun 05 20:28:52.402508 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:52.402398 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"9d2318c942545677e3baac730ad8a05073a774c3b7089332f86963acb1c8b11e"} Jun 05 20:28:53.238089 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.237908 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:28:53.238257 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.237908 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:28:53.238257 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.237913 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:28:53.240842 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.240817 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:28:53.240971 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.240860 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:28:53.240971 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.240888 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:28:53.240971 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.240946 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:28:53.241762 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.241742 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lr7q7\"" Jun 05 20:28:53.241762 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.241743 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w9dkz\"" Jun 05 20:28:53.380138 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.380061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:53.380631 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:53.380431 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:28:53.380631 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:53.380523 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:55.380474939 +0000 UTC m=+39.618142249 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:28:53.408838 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.408798 2583 generic.go:356] "Generic (PLEG): container finished" podID="0e926585-1ea2-42af-9b66-ec370e88a915" containerID="931460b380c700c0e568e07e98bf797b3f1c6f763023fe1ed0c9119b8f80b300" exitCode=0 Jun 05 20:28:53.408994 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:53.408842 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerDied","Data":"931460b380c700c0e568e07e98bf797b3f1c6f763023fe1ed0c9119b8f80b300"} Jun 05 20:28:54.414089 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:54.414053 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" event={"ID":"0e926585-1ea2-42af-9b66-ec370e88a915","Type":"ContainerStarted","Data":"7fac36db0394a48f9fc9fc7dc54efc19b8709e8016f69d3fcdea0d27628d2428"} Jun 05 20:28:54.415294 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:54.415273 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9gdxv" event={"ID":"7a2affb5-e23f-4b37-b6ba-ec2f75b21005","Type":"ContainerStarted","Data":"a8da12c6b5ee8969540d9694d751ed8d6970628239d14bd54c9ac2770d567d5c"} Jun 05 20:28:54.437366 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:54.437327 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vt5g9" podStartSLOduration=8.604222918 podStartE2EDuration="38.43731017s" totalImagesPullingTime="29.833087252s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:54.436061795 +0000 UTC m=+38.673729110" watchObservedRunningTime="2026-06-05 20:28:54.43731017 +0000 UTC m=+38.674977485" Jun 05 20:28:54.450188 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:54.450149 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9gdxv" podStartSLOduration=1.933613361 podStartE2EDuration="3.450133336s" totalImagesPullingTime="1.516519975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:28:54.449891641 +0000 UTC m=+38.687558967" watchObservedRunningTime="2026-06-05 20:28:54.450133336 +0000 UTC m=+38.687800649" Jun 05 20:28:55.394754 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:55.394706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:55.394927 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:55.394874 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:28:55.394967 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:55.394958 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:28:59.394940903 +0000 UTC m=+43.632608196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:28:59.416101 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:28:59.416061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:28:59.416718 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:59.416194 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:28:59.416718 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:28:59.416266 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:29:07.41624449 +0000 UTC m=+51.653911783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:29:07.472574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:07.472541 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:29:07.473030 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:07.472713 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:29:07.473030 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:07.472787 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:29:23.472766332 +0000 UTC m=+67.710433635 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:29:15.391299 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:15.391271 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ptlgq" Jun 05 20:29:21.971839 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:21.971800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:29:21.974415 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:21.974398 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 20:29:21.985226 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:21.985204 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7f5319b7-1b84-4521-87c1-2cb5acb0b70b-original-pull-secret\") pod \"global-pull-secret-syncer-jpbpg\" (UID: \"7f5319b7-1b84-4521-87c1-2cb5acb0b70b\") " pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:29:22.049366 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.049320 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jpbpg" Jun 05 20:29:22.072219 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.072192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:29:22.074581 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.074550 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 20:29:22.082367 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:22.082347 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 20:29:22.082449 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:22.082436 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:30:26.0824022 +0000 UTC m=+130.320069496 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : secret "metrics-daemon-secret" not found Jun 05 20:29:22.167692 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.167665 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jpbpg"] Jun 05 20:29:22.171049 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:29:22.171023 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f5319b7_1b84_4521_87c1_2cb5acb0b70b.slice/crio-406460f65decbbff55d38d2ed06fa892c27ca00594867cebfe8a2c66fbbc0fe7 WatchSource:0}: Error finding container 406460f65decbbff55d38d2ed06fa892c27ca00594867cebfe8a2c66fbbc0fe7: Status 404 returned error can't find the container with id 406460f65decbbff55d38d2ed06fa892c27ca00594867cebfe8a2c66fbbc0fe7 Jun 05 20:29:22.172610 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.172460 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:29:22.174944 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.174923 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 20:29:22.185265 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.185250 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 20:29:22.195465 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.195445 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx6kz\" (UniqueName: \"kubernetes.io/projected/8744dc21-1c18-4c48-b085-bfe36b22d704-kube-api-access-jx6kz\") pod \"network-check-target-hp5s8\" (UID: \"8744dc21-1c18-4c48-b085-bfe36b22d704\") " pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:29:22.364965 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.364942 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lr7q7\"" Jun 05 20:29:22.373634 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.373606 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:29:22.477920 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.477883 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpbpg" event={"ID":"7f5319b7-1b84-4521-87c1-2cb5acb0b70b","Type":"ContainerStarted","Data":"406460f65decbbff55d38d2ed06fa892c27ca00594867cebfe8a2c66fbbc0fe7"} Jun 05 20:29:22.489331 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:22.489305 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hp5s8"] Jun 05 20:29:22.492255 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:29:22.492230 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8744dc21_1c18_4c48_b085_bfe36b22d704.slice/crio-72567d759b3abf1dd5af2a71844d4434032df3fce70e5a04aba079cb433aae16 WatchSource:0}: Error finding container 72567d759b3abf1dd5af2a71844d4434032df3fce70e5a04aba079cb433aae16: Status 404 returned error can't find the container with id 72567d759b3abf1dd5af2a71844d4434032df3fce70e5a04aba079cb433aae16 Jun 05 20:29:23.481918 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:23.481874 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hp5s8" event={"ID":"8744dc21-1c18-4c48-b085-bfe36b22d704","Type":"ContainerStarted","Data":"72567d759b3abf1dd5af2a71844d4434032df3fce70e5a04aba079cb433aae16"} Jun 05 20:29:23.485270 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:23.485238 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:29:23.485417 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:23.485398 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:29:23.485505 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:23.485468 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:29:55.48545302 +0000 UTC m=+99.723120327 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:29:27.493828 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:27.493795 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hp5s8" event={"ID":"8744dc21-1c18-4c48-b085-bfe36b22d704","Type":"ContainerStarted","Data":"34a1c0619b24b6065325f66c2c18d1a1184036660abb50400e2da4129294635f"} Jun 05 20:29:27.494348 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:27.493877 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:29:27.495351 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:27.495327 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jpbpg" event={"ID":"7f5319b7-1b84-4521-87c1-2cb5acb0b70b","Type":"ContainerStarted","Data":"9e87cae2a221342660c55e8245257ff290a5099f6c76e7de812b25660dffb5dc"} Jun 05 20:29:27.523456 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:27.523408 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hp5s8" podStartSLOduration=66.740836849 podStartE2EDuration="1m11.523389661s" totalImagesPullingTime="4.782552812s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:29:27.509930124 +0000 UTC m=+71.747597441" watchObservedRunningTime="2026-06-05 20:29:27.523389661 +0000 UTC m=+71.761056972" Jun 05 20:29:27.523778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:27.523746 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jpbpg" podStartSLOduration=66.428751195 podStartE2EDuration="1m11.523734082s" totalImagesPullingTime="5.094982887s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:29:27.523192907 +0000 UTC m=+71.760860225" watchObservedRunningTime="2026-06-05 20:29:27.523734082 +0000 UTC m=+71.761401397" Jun 05 20:29:55.508165 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:55.508127 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:29:55.508610 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:55.508235 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:29:55.508610 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:29:55.508287 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:30:59.508273596 +0000 UTC m=+163.745940889 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:29:58.500110 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:29:58.500082 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hp5s8" Jun 05 20:30:26.107568 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:30:26.107517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:30:26.108045 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:26.107662 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 20:30:26.108045 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:26.107733 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs podName:d68e2a6e-118c-49fa-b506-930b8c693e4a nodeName:}" failed. No retries permitted until 2026-06-05 20:32:28.10771624 +0000 UTC m=+252.345383544 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs") pod "network-metrics-daemon-jlbxb" (UID: "d68e2a6e-118c-49fa-b506-930b8c693e4a") : secret "metrics-daemon-secret" not found Jun 05 20:30:54.601017 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:54.600972 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pm5ml" podUID="733405a4-43d0-4c67-a74c-2667f29c3fb7" Jun 05 20:30:54.699651 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:30:54.699587 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:30:56.256439 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:56.256404 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-jlbxb" podUID="d68e2a6e-118c-49fa-b506-930b8c693e4a" Jun 05 20:30:59.532733 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:30:59.532674 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:30:59.533210 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:59.532829 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 20:30:59.533210 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:30:59.532896 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls podName:733405a4-43d0-4c67-a74c-2667f29c3fb7 nodeName:}" failed. No retries permitted until 2026-06-05 20:33:01.5328785 +0000 UTC m=+285.770545794 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls") pod "dns-default-pm5ml" (UID: "733405a4-43d0-4c67-a74c-2667f29c3fb7") : secret "dns-default-metrics-tls" not found Jun 05 20:31:11.237187 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:11.237083 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:31:59.815426 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.815388 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz"] Jun 05 20:31:59.817304 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.817283 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l6n46"] Jun 05 20:31:59.817431 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.817395 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:31:59.818932 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.818914 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:31:59.821354 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821331 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:31:59.821354 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821348 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 20:31:59.821520 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821470 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 20:31:59.821584 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821515 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kkqxk\"" Jun 05 20:31:59.821584 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821541 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-q6kbr\"" Jun 05 20:31:59.821678 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821611 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 20:31:59.821678 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821658 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 20:31:59.821743 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.821726 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 20:31:59.822600 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.822581 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 20:31:59.822729 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.822710 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 20:31:59.829459 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.829436 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 20:31:59.837278 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.837257 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz"] Jun 05 20:31:59.840979 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.840961 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l6n46"] Jun 05 20:31:59.901717 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.901688 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn"] Jun 05 20:31:59.903333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.903318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:31:59.905664 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.905644 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 20:31:59.905808 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.905791 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 20:31:59.905875 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.905812 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 20:31:59.905875 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.905860 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 20:31:59.905986 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.905881 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9bgzv\"" Jun 05 20:31:59.909670 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.909642 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5586557d87-f9rfv"] Jun 05 20:31:59.914832 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.914810 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-896549976-txs7k"] Jun 05 20:31:59.914952 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.914937 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:31:59.917085 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917064 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:31:59.917190 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917127 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8vbjw\"" Jun 05 20:31:59.917260 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917130 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 20:31:59.917715 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917675 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn"] Jun 05 20:31:59.917715 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917712 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 20:31:59.917995 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.917980 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 20:31:59.918066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.918009 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 20:31:59.918066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.918015 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 20:31:59.918521 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.918506 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 20:31:59.919818 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.919797 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 05 20:31:59.919818 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.919797 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 20:31:59.919974 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.919799 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 20:31:59.919974 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.919835 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 05 20:31:59.919974 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.919855 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mw9hr\"" Jun 05 20:31:59.924750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.924730 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 05 20:31:59.929041 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.929020 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-txs7k"] Jun 05 20:31:59.929778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.929759 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5586557d87-f9rfv"] Jun 05 20:31:59.937413 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937386 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b8286f-8961-471b-9e19-0ea772134dc5-serving-cert\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:31:59.937528 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937419 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-trusted-ca\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:31:59.937583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937526 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa49ea1a-d30e-40ab-a406-53076125dbe8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:31:59.937583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937557 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-config\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:31:59.937657 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937601 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa49ea1a-d30e-40ab-a406-53076125dbe8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:31:59.937657 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937632 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjv5\" (UniqueName: \"kubernetes.io/projected/aa49ea1a-d30e-40ab-a406-53076125dbe8-kube-api-access-2xjv5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:31:59.937734 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:31:59.937702 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tf88\" (UniqueName: \"kubernetes.io/projected/38b8286f-8961-471b-9e19-0ea772134dc5-kube-api-access-2tf88\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.038846 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.038808 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvgkg\" (UniqueName: \"kubernetes.io/projected/b79a0181-611d-41d5-8b26-39e4a4576963-kube-api-access-lvgkg\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.038846 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.038847 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-service-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039096 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.038878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tf88\" (UniqueName: \"kubernetes.io/projected/38b8286f-8961-471b-9e19-0ea772134dc5-kube-api-access-2tf88\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.039096 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-trusted-ca\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.039096 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-trusted-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039096 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-stats-auth\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.039257 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039214 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-tmp\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039257 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039240 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-snapshots\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039330 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039266 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa49ea1a-d30e-40ab-a406-53076125dbe8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.039372 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039330 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84765\" (UniqueName: \"kubernetes.io/projected/953a8b85-c9e1-469b-a230-0da7037e725d-kube-api-access-84765\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.039372 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b8286f-8961-471b-9e19-0ea772134dc5-serving-cert\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.039474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039390 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-serving-cert\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039410 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-default-certificate\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.039474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa49ea1a-d30e-40ab-a406-53076125dbe8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.039474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039460 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-config\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.039705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039516 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzfcj\" (UniqueName: \"kubernetes.io/projected/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-kube-api-access-mzfcj\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.039705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039550 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953a8b85-c9e1-469b-a230-0da7037e725d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.039705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039573 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.039705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039596 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.039705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjv5\" (UniqueName: \"kubernetes.io/projected/aa49ea1a-d30e-40ab-a406-53076125dbe8-kube-api-access-2xjv5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.039947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.039752 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.040029 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.040007 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-trusted-ca\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.040082 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.040029 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/aa49ea1a-d30e-40ab-a406-53076125dbe8-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.040133 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.040078 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/38b8286f-8961-471b-9e19-0ea772134dc5-config\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.041595 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.041572 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/aa49ea1a-d30e-40ab-a406-53076125dbe8-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.041705 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.041687 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/38b8286f-8961-471b-9e19-0ea772134dc5-serving-cert\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.046302 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.046264 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tf88\" (UniqueName: \"kubernetes.io/projected/38b8286f-8961-471b-9e19-0ea772134dc5-kube-api-access-2tf88\") pod \"console-operator-668fdbf85c-l6n46\" (UID: \"38b8286f-8961-471b-9e19-0ea772134dc5\") " pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.046952 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.046928 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjv5\" (UniqueName: \"kubernetes.io/projected/aa49ea1a-d30e-40ab-a406-53076125dbe8-kube-api-access-2xjv5\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mpskz\" (UID: \"aa49ea1a-d30e-40ab-a406-53076125dbe8\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.127269 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.127169 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" Jun 05 20:32:00.132801 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.132780 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:00.140843 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.140796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzfcj\" (UniqueName: \"kubernetes.io/projected/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-kube-api-access-mzfcj\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141067 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141038 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953a8b85-c9e1-469b-a230-0da7037e725d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.141168 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141084 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.141168 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141114 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.141168 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141142 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvgkg\" (UniqueName: \"kubernetes.io/projected/b79a0181-611d-41d5-8b26-39e4a4576963-kube-api-access-lvgkg\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-service-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.141239 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:00.641215447 +0000 UTC m=+224.878882760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141286 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-trusted-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.141295 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:00.141333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141322 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-stats-auth\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.141347 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:00.641330321 +0000 UTC m=+224.878997614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141396 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-tmp\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141422 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-snapshots\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84765\" (UniqueName: \"kubernetes.io/projected/953a8b85-c9e1-469b-a230-0da7037e725d-kube-api-access-84765\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141539 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-serving-cert\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141663 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141567 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-default-certificate\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.141975 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141832 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/953a8b85-c9e1-469b-a230-0da7037e725d-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.141975 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.141846 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-service-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.141975 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.141240 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 20:32:00.141975 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.141925 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:00.641909092 +0000 UTC m=+224.879576403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : secret "router-metrics-certs-default" not found Jun 05 20:32:00.144455 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.144432 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-stats-auth\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.144455 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.144450 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-default-certificate\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.144604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.144564 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-snapshots\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.144789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.144763 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-tmp\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.145312 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.145280 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-trusted-ca-bundle\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.146605 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.146585 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-serving-cert\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.150404 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.150381 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzfcj\" (UniqueName: \"kubernetes.io/projected/39a35b7a-a4ec-4599-b2db-01fae8d17e2c-kube-api-access-mzfcj\") pod \"insights-operator-896549976-txs7k\" (UID: \"39a35b7a-a4ec-4599-b2db-01fae8d17e2c\") " pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.150829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.150805 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvgkg\" (UniqueName: \"kubernetes.io/projected/b79a0181-611d-41d5-8b26-39e4a4576963-kube-api-access-lvgkg\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.151068 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.151032 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84765\" (UniqueName: \"kubernetes.io/projected/953a8b85-c9e1-469b-a230-0da7037e725d-kube-api-access-84765\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.231817 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.231788 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-896549976-txs7k" Jun 05 20:32:00.258689 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.258659 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz"] Jun 05 20:32:00.261925 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:00.261897 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa49ea1a_d30e_40ab_a406_53076125dbe8.slice/crio-693d48886f320556fa2d356015b18f1097f26284f5c66fbcd3c3e02b875f1ded WatchSource:0}: Error finding container 693d48886f320556fa2d356015b18f1097f26284f5c66fbcd3c3e02b875f1ded: Status 404 returned error can't find the container with id 693d48886f320556fa2d356015b18f1097f26284f5c66fbcd3c3e02b875f1ded Jun 05 20:32:00.274777 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.274751 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-l6n46"] Jun 05 20:32:00.277705 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:00.277678 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38b8286f_8961_471b_9e19_0ea772134dc5.slice/crio-b0037d2d7f9df7b95707a02fd4b2819fcfdbc36b6ab676db18aecdd607040960 WatchSource:0}: Error finding container b0037d2d7f9df7b95707a02fd4b2819fcfdbc36b6ab676db18aecdd607040960: Status 404 returned error can't find the container with id b0037d2d7f9df7b95707a02fd4b2819fcfdbc36b6ab676db18aecdd607040960 Jun 05 20:32:00.358645 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.358617 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-896549976-txs7k"] Jun 05 20:32:00.361972 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:00.361947 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39a35b7a_a4ec_4599_b2db_01fae8d17e2c.slice/crio-0e95f07d93e007267452f22a242e12d005d581bef3eb3cfcb97fb8bee516f1fe WatchSource:0}: Error finding container 0e95f07d93e007267452f22a242e12d005d581bef3eb3cfcb97fb8bee516f1fe: Status 404 returned error can't find the container with id 0e95f07d93e007267452f22a242e12d005d581bef3eb3cfcb97fb8bee516f1fe Jun 05 20:32:00.645752 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.645723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.645752 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.645757 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:00.645950 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.645776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:00.645950 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.645890 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 20:32:00.645950 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.645922 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:01.645898942 +0000 UTC m=+225.883566243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:00.645950 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.645924 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:00.645950 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.645943 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:01.645933679 +0000 UTC m=+225.883600976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : secret "router-metrics-certs-default" not found Jun 05 20:32:00.646104 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:00.645978 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:01.645963536 +0000 UTC m=+225.883630829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:00.857535 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.857499 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-txs7k" event={"ID":"39a35b7a-a4ec-4599-b2db-01fae8d17e2c","Type":"ContainerStarted","Data":"0e95f07d93e007267452f22a242e12d005d581bef3eb3cfcb97fb8bee516f1fe"} Jun 05 20:32:00.858829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.858798 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" event={"ID":"aa49ea1a-d30e-40ab-a406-53076125dbe8","Type":"ContainerStarted","Data":"693d48886f320556fa2d356015b18f1097f26284f5c66fbcd3c3e02b875f1ded"} Jun 05 20:32:00.860116 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:00.860093 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" event={"ID":"38b8286f-8961-471b-9e19-0ea772134dc5","Type":"ContainerStarted","Data":"b0037d2d7f9df7b95707a02fd4b2819fcfdbc36b6ab676db18aecdd607040960"} Jun 05 20:32:01.654046 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:01.654007 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:01.654046 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:01.654052 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:01.654291 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:01.654079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:01.654291 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:01.654184 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:03.654164383 +0000 UTC m=+227.891831690 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:01.654291 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:01.654260 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:01.654453 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:01.654261 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 20:32:01.654453 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:01.654413 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:03.654375319 +0000 UTC m=+227.892042632 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:01.654453 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:01.654434 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:03.654424457 +0000 UTC m=+227.892091755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : secret "router-metrics-certs-default" not found Jun 05 20:32:03.672231 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.672126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:03.672231 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.672185 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:03.672231 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.672216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:03.672734 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:03.672295 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:07.672274944 +0000 UTC m=+231.909942252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:03.672734 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:03.672359 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:03.672734 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:03.672361 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 20:32:03.672734 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:03.672416 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:07.672400062 +0000 UTC m=+231.910067357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:03.672734 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:03.672434 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:07.672423499 +0000 UTC m=+231.910090798 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : secret "router-metrics-certs-default" not found Jun 05 20:32:03.870163 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.870124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-txs7k" event={"ID":"39a35b7a-a4ec-4599-b2db-01fae8d17e2c","Type":"ContainerStarted","Data":"7098f1718eae431b2112a62279f7de7d5d8d92d41a7a10d9f8199bf148014fcd"} Jun 05 20:32:03.871762 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.871730 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" event={"ID":"aa49ea1a-d30e-40ab-a406-53076125dbe8","Type":"ContainerStarted","Data":"decf38e9da1aadaa3c534fecf9aa7e91ab1d411da91ca47780e93a23a2f41050"} Jun 05 20:32:03.873285 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.873267 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/0.log" Jun 05 20:32:03.873406 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.873297 2583 generic.go:356] "Generic (PLEG): container finished" podID="38b8286f-8961-471b-9e19-0ea772134dc5" containerID="da7b11abd317707dc5a41136c2fbb4db03d994381a89888957b5433904b99701" exitCode=255 Jun 05 20:32:03.873406 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.873326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" event={"ID":"38b8286f-8961-471b-9e19-0ea772134dc5","Type":"ContainerDied","Data":"da7b11abd317707dc5a41136c2fbb4db03d994381a89888957b5433904b99701"} Jun 05 20:32:03.873564 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.873549 2583 scope.go:117] "RemoveContainer" containerID="da7b11abd317707dc5a41136c2fbb4db03d994381a89888957b5433904b99701" Jun 05 20:32:03.887576 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.887540 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-896549976-txs7k" podStartSLOduration=1.877898882 podStartE2EDuration="4.887527898s" totalImagesPullingTime="3.009629016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:03.885854915 +0000 UTC m=+228.123522232" watchObservedRunningTime="2026-06-05 20:32:03.887527898 +0000 UTC m=+228.125195191" Jun 05 20:32:03.919593 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:03.919549 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" podStartSLOduration=1.813156868 podStartE2EDuration="4.919533759s" totalImagesPullingTime="3.106376891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:03.918325113 +0000 UTC m=+228.155992430" watchObservedRunningTime="2026-06-05 20:32:03.919533759 +0000 UTC m=+228.157201074" Jun 05 20:32:04.879273 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.879247 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/1.log" Jun 05 20:32:04.879806 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.879785 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/0.log" Jun 05 20:32:04.879868 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.879833 2583 generic.go:356] "Generic (PLEG): container finished" podID="38b8286f-8961-471b-9e19-0ea772134dc5" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" exitCode=255 Jun 05 20:32:04.879952 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.879930 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" event={"ID":"38b8286f-8961-471b-9e19-0ea772134dc5","Type":"ContainerDied","Data":"c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5"} Jun 05 20:32:04.880007 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.879993 2583 scope.go:117] "RemoveContainer" containerID="da7b11abd317707dc5a41136c2fbb4db03d994381a89888957b5433904b99701" Jun 05 20:32:04.880299 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:04.880277 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:04.880523 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:04.880463 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:05.748573 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.748538 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-6kxvt"] Jun 05 20:32:05.752332 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.752316 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.755151 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.755110 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 20:32:05.755280 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.755263 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 20:32:05.755756 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.755740 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xqhpj\"" Jun 05 20:32:05.755756 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.755751 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 20:32:05.757411 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.757391 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 20:32:05.769126 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.769103 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-6kxvt"] Jun 05 20:32:05.883624 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.883597 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/1.log" Jun 05 20:32:05.884006 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.883978 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:05.884186 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:05.884163 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:05.892321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.892295 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sp2p\" (UniqueName: \"kubernetes.io/projected/4c59bf4d-fd25-494b-99ac-6f101744f3cf-kube-api-access-4sp2p\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.892437 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.892364 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-key\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.892514 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.892455 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-cabundle\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.898037 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.898016 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln"] Jun 05 20:32:05.904346 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.904321 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" Jun 05 20:32:05.906724 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.906702 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 05 20:32:05.906880 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.906742 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-lk9kj\"" Jun 05 20:32:05.906880 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.906742 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 05 20:32:05.908099 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.908080 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln"] Jun 05 20:32:05.993247 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.993208 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-cabundle\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.993556 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.993527 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sp2p\" (UniqueName: \"kubernetes.io/projected/4c59bf4d-fd25-494b-99ac-6f101744f3cf-kube-api-access-4sp2p\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.993695 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.993618 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-key\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.993757 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.993697 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5btd4\" (UniqueName: \"kubernetes.io/projected/c587ee2a-7736-47e7-b446-fc5d52488402-kube-api-access-5btd4\") pod \"migrator-955ffdf5f-v8vln\" (UID: \"c587ee2a-7736-47e7-b446-fc5d52488402\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" Jun 05 20:32:05.993979 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.993960 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-cabundle\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:05.995994 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:05.995973 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4c59bf4d-fd25-494b-99ac-6f101744f3cf-signing-key\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:06.001063 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.001003 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sp2p\" (UniqueName: \"kubernetes.io/projected/4c59bf4d-fd25-494b-99ac-6f101744f3cf-kube-api-access-4sp2p\") pod \"service-ca-7d74d578b8-6kxvt\" (UID: \"4c59bf4d-fd25-494b-99ac-6f101744f3cf\") " pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:06.061401 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.061362 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" Jun 05 20:32:06.094184 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.094158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5btd4\" (UniqueName: \"kubernetes.io/projected/c587ee2a-7736-47e7-b446-fc5d52488402-kube-api-access-5btd4\") pod \"migrator-955ffdf5f-v8vln\" (UID: \"c587ee2a-7736-47e7-b446-fc5d52488402\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" Jun 05 20:32:06.102331 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.102302 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5btd4\" (UniqueName: \"kubernetes.io/projected/c587ee2a-7736-47e7-b446-fc5d52488402-kube-api-access-5btd4\") pod \"migrator-955ffdf5f-v8vln\" (UID: \"c587ee2a-7736-47e7-b446-fc5d52488402\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" Jun 05 20:32:06.179550 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.179523 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-6kxvt"] Jun 05 20:32:06.182258 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:06.182229 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c59bf4d_fd25_494b_99ac_6f101744f3cf.slice/crio-46b4d7e181250209ce5bcf723311d8c4d388fb056579b682fe2bd6436be326b5 WatchSource:0}: Error finding container 46b4d7e181250209ce5bcf723311d8c4d388fb056579b682fe2bd6436be326b5: Status 404 returned error can't find the container with id 46b4d7e181250209ce5bcf723311d8c4d388fb056579b682fe2bd6436be326b5 Jun 05 20:32:06.214360 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.214337 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" Jun 05 20:32:06.341132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.341104 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln"] Jun 05 20:32:06.345069 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:06.345041 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc587ee2a_7736_47e7_b446_fc5d52488402.slice/crio-64aade4039fecc822d8560743cda6ebb6b06b7cd1a973f35068ce2b7b57abc0a WatchSource:0}: Error finding container 64aade4039fecc822d8560743cda6ebb6b06b7cd1a973f35068ce2b7b57abc0a: Status 404 returned error can't find the container with id 64aade4039fecc822d8560743cda6ebb6b06b7cd1a973f35068ce2b7b57abc0a Jun 05 20:32:06.768714 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.768688 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jpnl_a45349a0-f3a3-4247-9c3a-8f3274e82617/dns-node-resolver/0.log" Jun 05 20:32:06.888338 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.888302 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" event={"ID":"c587ee2a-7736-47e7-b446-fc5d52488402","Type":"ContainerStarted","Data":"64aade4039fecc822d8560743cda6ebb6b06b7cd1a973f35068ce2b7b57abc0a"} Jun 05 20:32:06.889588 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:06.889561 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" event={"ID":"4c59bf4d-fd25-494b-99ac-6f101744f3cf","Type":"ContainerStarted","Data":"46b4d7e181250209ce5bcf723311d8c4d388fb056579b682fe2bd6436be326b5"} Jun 05 20:32:07.706411 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:07.706371 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:07.706639 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:07.706515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:07.706639 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:07.706550 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:07.706639 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:07.706549 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:07.706811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:07.706651 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:15.706630938 +0000 UTC m=+239.944298238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:07.706811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:07.706668 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 20:32:07.706811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:07.706672 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:15.706662439 +0000 UTC m=+239.944329732 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:07.706811 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:07.706734 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:15.706717702 +0000 UTC m=+239.944384998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : secret "router-metrics-certs-default" not found Jun 05 20:32:08.168409 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.168386 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xns9l_42b491bf-f1e3-437f-bb57-0dcf8c59e06e/node-ca/0.log" Jun 05 20:32:08.567973 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.567948 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gdxv_7a2affb5-e23f-4b37-b6ba-ec2f75b21005/serve-healthcheck-canary/0.log" Jun 05 20:32:08.897649 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.897557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" event={"ID":"c587ee2a-7736-47e7-b446-fc5d52488402","Type":"ContainerStarted","Data":"866dd1d2be61fef95bd21d05e0a07399bbdbab6bc26e25451823983e66c78281"} Jun 05 20:32:08.897649 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.897623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" event={"ID":"c587ee2a-7736-47e7-b446-fc5d52488402","Type":"ContainerStarted","Data":"9ad558443481eae9ca5cd3282f5f1e87c4c6b3073b76e21369e4a24add9cfec2"} Jun 05 20:32:08.898888 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.898864 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" event={"ID":"4c59bf4d-fd25-494b-99ac-6f101744f3cf","Type":"ContainerStarted","Data":"e63e855011e95eed97fa7399980aeb7e2c3898cbb9955dc4d95d096de5977072"} Jun 05 20:32:08.913005 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.912960 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-v8vln" podStartSLOduration=2.159064046 podStartE2EDuration="3.912942083s" totalImagesPullingTime="1.753878037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:08.911936186 +0000 UTC m=+233.149603501" watchObservedRunningTime="2026-06-05 20:32:08.912942083 +0000 UTC m=+233.150609398" Jun 05 20:32:08.926714 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:08.926677 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-6kxvt" podStartSLOduration=2.009756998 podStartE2EDuration="3.926664721s" totalImagesPullingTime="1.916907723s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:08.92594785 +0000 UTC m=+233.163615166" watchObservedRunningTime="2026-06-05 20:32:08.926664721 +0000 UTC m=+233.164332036" Jun 05 20:32:10.133826 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:10.133736 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:10.134258 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:10.134214 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:10.134409 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:10.134381 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:10.134599 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:10.134390 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:10.904658 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:10.904633 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:10.904817 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:10.904778 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:15.772197 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:15.772161 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:15.772197 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:15.772198 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:15.772644 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:15.772216 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:15.772644 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:15.772332 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle podName:b79a0181-611d-41d5-8b26-39e4a4576963 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:31.772315123 +0000 UTC m=+256.009982416 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle") pod "router-default-5586557d87-f9rfv" (UID: "b79a0181-611d-41d5-8b26-39e4a4576963") : configmap references non-existent config key: service-ca.crt Jun 05 20:32:15.772644 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:15.772361 2583 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:15.772644 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:15.772408 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls podName:953a8b85-c9e1-469b-a230-0da7037e725d nodeName:}" failed. No retries permitted until 2026-06-05 20:32:31.772397448 +0000 UTC m=+256.010064741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-wlfnn" (UID: "953a8b85-c9e1-469b-a230-0da7037e725d") : secret "cluster-monitoring-operator-tls" not found Jun 05 20:32:15.774611 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:15.774590 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b79a0181-611d-41d5-8b26-39e4a4576963-metrics-certs\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:23.237891 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.237862 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:23.944328 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.944301 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:32:23.944735 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.944718 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/1.log" Jun 05 20:32:23.944861 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.944754 2583 generic.go:356] "Generic (PLEG): container finished" podID="38b8286f-8961-471b-9e19-0ea772134dc5" containerID="b1adf352a1ee9a671c151f182b7dd4d399277e7ce460d996c8b0185c11378f83" exitCode=255 Jun 05 20:32:23.944861 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.944821 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" event={"ID":"38b8286f-8961-471b-9e19-0ea772134dc5","Type":"ContainerDied","Data":"b1adf352a1ee9a671c151f182b7dd4d399277e7ce460d996c8b0185c11378f83"} Jun 05 20:32:23.944962 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.944878 2583 scope.go:117] "RemoveContainer" containerID="c5c2b5d50b9b10419ac0e5b9811d8654aae73111cf546ba0af517e615701cef5" Jun 05 20:32:23.945266 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:23.945252 2583 scope.go:117] "RemoveContainer" containerID="b1adf352a1ee9a671c151f182b7dd4d399277e7ce460d996c8b0185c11378f83" Jun 05 20:32:23.945421 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:23.945393 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:24.951367 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:24.951343 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:32:27.084734 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.084703 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ncc8t"] Jun 05 20:32:27.116582 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.116552 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncc8t"] Jun 05 20:32:27.116764 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.116748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.119597 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.119575 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tj6sm\"" Jun 05 20:32:27.120341 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.120323 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 20:32:27.120414 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.120330 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 20:32:27.156427 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.156404 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-data-volume\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.156556 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.156449 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.156556 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.156471 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6f5l\" (UniqueName: \"kubernetes.io/projected/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-api-access-g6f5l\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.156556 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.156541 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.156660 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.156563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-crio-socket\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.256921 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.256890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257083 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.256938 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-crio-socket\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257083 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257017 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-data-volume\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257083 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257049 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-crio-socket\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257083 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257071 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257263 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257099 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6f5l\" (UniqueName: \"kubernetes.io/projected/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-api-access-g6f5l\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257434 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257405 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-data-volume\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.257622 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.257595 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.259438 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.259421 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.265947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.265919 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6f5l\" (UniqueName: \"kubernetes.io/projected/a0fe8ef4-6932-4d5a-8457-8dcb57b80412-kube-api-access-g6f5l\") pod \"insights-runtime-extractor-ncc8t\" (UID: \"a0fe8ef4-6932-4d5a-8457-8dcb57b80412\") " pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.426231 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.426161 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ncc8t" Jun 05 20:32:27.568707 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.568681 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ncc8t"] Jun 05 20:32:27.571977 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:27.571953 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0fe8ef4_6932_4d5a_8457_8dcb57b80412.slice/crio-dd130d779052b1ee01fde761e4db31016fdc3d60ceea51dabd78093c61f1de43 WatchSource:0}: Error finding container dd130d779052b1ee01fde761e4db31016fdc3d60ceea51dabd78093c61f1de43: Status 404 returned error can't find the container with id dd130d779052b1ee01fde761e4db31016fdc3d60ceea51dabd78093c61f1de43 Jun 05 20:32:27.961443 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.961366 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncc8t" event={"ID":"a0fe8ef4-6932-4d5a-8457-8dcb57b80412","Type":"ContainerStarted","Data":"ee1cdefc316515c81158a43f2e5f1dfb07280026f6fb28f2ec1566b8663f81c5"} Jun 05 20:32:27.961443 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:27.961425 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncc8t" event={"ID":"a0fe8ef4-6932-4d5a-8457-8dcb57b80412","Type":"ContainerStarted","Data":"dd130d779052b1ee01fde761e4db31016fdc3d60ceea51dabd78093c61f1de43"} Jun 05 20:32:28.164771 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.164739 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:32:28.167018 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.166998 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d68e2a6e-118c-49fa-b506-930b8c693e4a-metrics-certs\") pod \"network-metrics-daemon-jlbxb\" (UID: \"d68e2a6e-118c-49fa-b506-930b8c693e4a\") " pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:32:28.340724 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.340696 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w9dkz\"" Jun 05 20:32:28.348689 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.348659 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jlbxb" Jun 05 20:32:28.565316 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.565281 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jlbxb"] Jun 05 20:32:28.568884 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:28.568853 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68e2a6e_118c_49fa_b506_930b8c693e4a.slice/crio-16dbf9fca5becd0da9dd651401e4be2272be78bee63df779ea0892726b273dec WatchSource:0}: Error finding container 16dbf9fca5becd0da9dd651401e4be2272be78bee63df779ea0892726b273dec: Status 404 returned error can't find the container with id 16dbf9fca5becd0da9dd651401e4be2272be78bee63df779ea0892726b273dec Jun 05 20:32:28.967102 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.967066 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncc8t" event={"ID":"a0fe8ef4-6932-4d5a-8457-8dcb57b80412","Type":"ContainerStarted","Data":"b190978f27c56afb502b4a2121766f9eb1e7c408c171de9003cae40698408db2"} Jun 05 20:32:28.968436 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:28.968394 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlbxb" event={"ID":"d68e2a6e-118c-49fa-b506-930b8c693e4a","Type":"ContainerStarted","Data":"16dbf9fca5becd0da9dd651401e4be2272be78bee63df779ea0892726b273dec"} Jun 05 20:32:29.975172 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:29.975130 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlbxb" event={"ID":"d68e2a6e-118c-49fa-b506-930b8c693e4a","Type":"ContainerStarted","Data":"d14b3a3a1b5f97bb049a1fb5881ea9db40246dd7843186409c725166e77a409b"} Jun 05 20:32:29.975607 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:29.975194 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jlbxb" event={"ID":"d68e2a6e-118c-49fa-b506-930b8c693e4a","Type":"ContainerStarted","Data":"1769990733afb76fb35bdb8617cffb47153807758c7a0af5b6798b7ed9d97a67"} Jun 05 20:32:29.991123 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:29.991074 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jlbxb" podStartSLOduration=253.232365096 podStartE2EDuration="4m13.991055665s" totalImagesPullingTime="758.690569ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:28:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:29.989829506 +0000 UTC m=+254.227496823" watchObservedRunningTime="2026-06-05 20:32:29.991055665 +0000 UTC m=+254.228722979" Jun 05 20:32:30.133225 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:30.133182 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:30.133384 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:30.133266 2583 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:30.133706 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:30.133685 2583 scope.go:117] "RemoveContainer" containerID="b1adf352a1ee9a671c151f182b7dd4d399277e7ce460d996c8b0185c11378f83" Jun 05 20:32:30.133926 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:30.133901 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-l6n46_openshift-console-operator(38b8286f-8961-471b-9e19-0ea772134dc5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podUID="38b8286f-8961-471b-9e19-0ea772134dc5" Jun 05 20:32:30.980897 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:30.980859 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ncc8t" event={"ID":"a0fe8ef4-6932-4d5a-8457-8dcb57b80412","Type":"ContainerStarted","Data":"0e7a6c6126c0a60dac3d697c01db6d238e165136c5a8dccd0961692b42bda5a7"} Jun 05 20:32:31.018835 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:31.018785 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ncc8t" podStartSLOduration=1.493787675 podStartE2EDuration="4.018770146s" totalImagesPullingTime="2.524982471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:32:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:31.018610835 +0000 UTC m=+255.256278159" watchObservedRunningTime="2026-06-05 20:32:31.018770146 +0000 UTC m=+255.256437461" Jun 05 20:32:31.794226 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:31.794187 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:31.794226 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:31.794225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:31.794833 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:31.794811 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b79a0181-611d-41d5-8b26-39e4a4576963-service-ca-bundle\") pod \"router-default-5586557d87-f9rfv\" (UID: \"b79a0181-611d-41d5-8b26-39e4a4576963\") " pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:31.796493 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:31.796453 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/953a8b85-c9e1-469b-a230-0da7037e725d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-wlfnn\" (UID: \"953a8b85-c9e1-469b-a230-0da7037e725d\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:32.015304 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.015274 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9bgzv\"" Jun 05 20:32:32.022954 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.022936 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" Jun 05 20:32:32.027617 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.027601 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-8vbjw\"" Jun 05 20:32:32.036375 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.036355 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:32.170205 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.170176 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn"] Jun 05 20:32:32.172928 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:32.172897 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod953a8b85_c9e1_469b_a230_0da7037e725d.slice/crio-8883bd31201be4d0fa0be29604777f75719bf3c60f78ff52a8cc7e7deb2f7362 WatchSource:0}: Error finding container 8883bd31201be4d0fa0be29604777f75719bf3c60f78ff52a8cc7e7deb2f7362: Status 404 returned error can't find the container with id 8883bd31201be4d0fa0be29604777f75719bf3c60f78ff52a8cc7e7deb2f7362 Jun 05 20:32:32.190402 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.190382 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5586557d87-f9rfv"] Jun 05 20:32:32.193283 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:32.193263 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb79a0181_611d_41d5_8b26_39e4a4576963.slice/crio-d4e7c109c38f74e94cd520a5215f477a8dbb0091ac3c15031c612b8d5864f90b WatchSource:0}: Error finding container d4e7c109c38f74e94cd520a5215f477a8dbb0091ac3c15031c612b8d5864f90b: Status 404 returned error can't find the container with id d4e7c109c38f74e94cd520a5215f477a8dbb0091ac3c15031c612b8d5864f90b Jun 05 20:32:32.990103 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.990066 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5586557d87-f9rfv" event={"ID":"b79a0181-611d-41d5-8b26-39e4a4576963","Type":"ContainerStarted","Data":"c9efa24c484a85a177e52a92750caad916d31ba9755c0cabf8ccb444b28753bd"} Jun 05 20:32:32.990285 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.990128 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5586557d87-f9rfv" event={"ID":"b79a0181-611d-41d5-8b26-39e4a4576963","Type":"ContainerStarted","Data":"d4e7c109c38f74e94cd520a5215f477a8dbb0091ac3c15031c612b8d5864f90b"} Jun 05 20:32:32.991374 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:32.991301 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" event={"ID":"953a8b85-c9e1-469b-a230-0da7037e725d","Type":"ContainerStarted","Data":"8883bd31201be4d0fa0be29604777f75719bf3c60f78ff52a8cc7e7deb2f7362"} Jun 05 20:32:33.009839 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:33.009783 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5586557d87-f9rfv" podStartSLOduration=34.0097629 podStartE2EDuration="34.0097629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:33.009461575 +0000 UTC m=+257.247128887" watchObservedRunningTime="2026-06-05 20:32:33.0097629 +0000 UTC m=+257.247430216" Jun 05 20:32:33.036709 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:33.036669 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:33.039374 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:33.039355 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:33.995090 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:33.995059 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:33.996454 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:33.996431 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5586557d87-f9rfv" Jun 05 20:32:35.000040 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:35.000004 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" event={"ID":"953a8b85-c9e1-469b-a230-0da7037e725d","Type":"ContainerStarted","Data":"d9e56355ff57472b25c7e7f0ff914cc7c2a9173c10622d0916be65db8b22f40f"} Jun 05 20:32:35.015168 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:35.015120 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-wlfnn" podStartSLOduration=33.800872103 podStartE2EDuration="36.015106763s" totalImagesPullingTime="2.21423466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:35.014090828 +0000 UTC m=+259.251758143" watchObservedRunningTime="2026-06-05 20:32:35.015106763 +0000 UTC m=+259.252774105" Jun 05 20:32:38.927912 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.927840 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v8976"] Jun 05 20:32:38.930974 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.930957 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:38.933092 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.933069 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 05 20:32:38.933264 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.933247 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 05 20:32:38.934128 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.934113 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fpj6q\"" Jun 05 20:32:38.934209 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.934136 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 20:32:38.938333 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:38.938304 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v8976"] Jun 05 20:32:39.048240 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.048204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfsz9\" (UniqueName: \"kubernetes.io/projected/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-kube-api-access-gfsz9\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.048423 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.048263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.048423 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.048292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.048423 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.048338 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.148905 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.148875 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.149043 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.148920 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.149043 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.148951 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.149043 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.148973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfsz9\" (UniqueName: \"kubernetes.io/projected/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-kube-api-access-gfsz9\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.149200 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:39.149051 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 05 20:32:39.149200 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:39.149118 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls podName:e9517a7e-b651-4f4f-90ff-3661fd89e9b0 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:39.649103214 +0000 UTC m=+263.886770507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-v8976" (UID: "e9517a7e-b651-4f4f-90ff-3661fd89e9b0") : secret "prometheus-operator-tls" not found Jun 05 20:32:39.149655 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.149632 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.151463 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.151446 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.157072 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.157048 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfsz9\" (UniqueName: \"kubernetes.io/projected/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-kube-api-access-gfsz9\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.652099 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.652057 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.654325 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.654307 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e9517a7e-b651-4f4f-90ff-3661fd89e9b0-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-v8976\" (UID: \"e9517a7e-b651-4f4f-90ff-3661fd89e9b0\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.840057 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.840009 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" Jun 05 20:32:39.962944 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:39.962908 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-v8976"] Jun 05 20:32:39.965889 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:39.965866 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9517a7e_b651_4f4f_90ff_3661fd89e9b0.slice/crio-6c2777bb65a995be461112172e83bd6c4458d8a66c8c42242f4f988466d0499e WatchSource:0}: Error finding container 6c2777bb65a995be461112172e83bd6c4458d8a66c8c42242f4f988466d0499e: Status 404 returned error can't find the container with id 6c2777bb65a995be461112172e83bd6c4458d8a66c8c42242f4f988466d0499e Jun 05 20:32:40.016832 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:40.016801 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" event={"ID":"e9517a7e-b651-4f4f-90ff-3661fd89e9b0","Type":"ContainerStarted","Data":"6c2777bb65a995be461112172e83bd6c4458d8a66c8c42242f4f988466d0499e"} Jun 05 20:32:42.024943 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:42.024909 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" event={"ID":"e9517a7e-b651-4f4f-90ff-3661fd89e9b0","Type":"ContainerStarted","Data":"c686267e805c27a184cf47559c134aa946cc4803a71bc074c94335a73c179eac"} Jun 05 20:32:42.025313 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:42.024962 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" event={"ID":"e9517a7e-b651-4f4f-90ff-3661fd89e9b0","Type":"ContainerStarted","Data":"bed1c09d522012742bab63209e8c1b09427e048bb31a6d58eb63cb996ab6cddd"} Jun 05 20:32:42.040632 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:42.040589 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-v8976" podStartSLOduration=2.68415597 podStartE2EDuration="4.040572111s" totalImagesPullingTime="1.356416141s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:42.039404027 +0000 UTC m=+266.277071342" watchObservedRunningTime="2026-06-05 20:32:42.040572111 +0000 UTC m=+266.278239426" Jun 05 20:32:44.238308 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.238276 2583 scope.go:117] "RemoveContainer" containerID="b1adf352a1ee9a671c151f182b7dd4d399277e7ce460d996c8b0185c11378f83" Jun 05 20:32:44.255429 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.255401 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4"] Jun 05 20:32:44.260115 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.260095 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.262710 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.262690 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 20:32:44.262847 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.262824 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nccdd\"" Jun 05 20:32:44.262989 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.262770 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 20:32:44.279776 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.279749 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4"] Jun 05 20:32:44.280161 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.280149 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs"] Jun 05 20:32:44.285766 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.285733 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l47wj"] Jun 05 20:32:44.285994 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.285977 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.288609 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.288591 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 20:32:44.288759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.288628 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 20:32:44.288833 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.288690 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 20:32:44.288951 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.288744 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dh896\"" Jun 05 20:32:44.289452 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.289436 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.293223 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.293198 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs"] Jun 05 20:32:44.293456 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.293440 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 20:32:44.293626 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.293606 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bp652\"" Jun 05 20:32:44.293722 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.293513 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 20:32:44.293905 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.293887 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 20:32:44.395132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-metrics-client-ca\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395152 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-root\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.395321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5gv4\" (UniqueName: \"kubernetes.io/projected/d2f063c2-303a-4e32-9160-b7350f52e326-kube-api-access-w5gv4\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.395321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395265 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.395321 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.395604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-accelerators-collector-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395376 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.395604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395405 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-sys\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-wtmp\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395550 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6074c847-b197-46ac-ba34-169b3fe49929-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvs5\" (UniqueName: \"kubernetes.io/projected/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-kube-api-access-khvs5\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395696 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395737 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395768 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395806 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-tls\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.395855 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395833 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm5xk\" (UniqueName: \"kubernetes.io/projected/6074c847-b197-46ac-ba34-169b3fe49929-kube-api-access-gm5xk\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.396146 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-textfile\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.396146 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.395905 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f063c2-303a-4e32-9160-b7350f52e326-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.497287 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.497287 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-tls\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm5xk\" (UniqueName: \"kubernetes.io/projected/6074c847-b197-46ac-ba34-169b3fe49929-kube-api-access-gm5xk\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-textfile\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497455 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f063c2-303a-4e32-9160-b7350f52e326-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497502 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-metrics-client-ca\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497533 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-root\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497583 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497610 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5gv4\" (UniqueName: \"kubernetes.io/projected/d2f063c2-303a-4e32-9160-b7350f52e326-kube-api-access-w5gv4\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497635 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497706 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-accelerators-collector-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497774 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-sys\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497809 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-wtmp\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497838 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6074c847-b197-46ac-ba34-169b3fe49929-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.497970 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.497862 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvs5\" (UniqueName: \"kubernetes.io/projected/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-kube-api-access-khvs5\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.499203 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.499177 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.499639 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.499452 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-root\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.500595 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.499920 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-metrics-client-ca\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.500595 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.500033 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-textfile\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.500595 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.500373 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2f063c2-303a-4e32-9160-b7350f52e326-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.500787 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:44.500632 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 20:32:44.500787 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.500667 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.500787 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:44.500701 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls podName:6074c847-b197-46ac-ba34-169b3fe49929 nodeName:}" failed. No retries permitted until 2026-06-05 20:32:45.000683265 +0000 UTC m=+269.238350577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-2l6fs" (UID: "6074c847-b197-46ac-ba34-169b3fe49929") : secret "kube-state-metrics-tls" not found Jun 05 20:32:44.500948 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.500935 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-wtmp\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.501047 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.500990 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-sys\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.501254 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.501231 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6074c847-b197-46ac-ba34-169b3fe49929-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.501698 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.501678 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-accelerators-collector-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.503219 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.503114 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.510123 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.510079 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d2f063c2-303a-4e32-9160-b7350f52e326-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.512805 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.512786 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.515090 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.514541 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvs5\" (UniqueName: \"kubernetes.io/projected/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-kube-api-access-khvs5\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.515090 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.514924 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.515090 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.515057 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5gv4\" (UniqueName: \"kubernetes.io/projected/d2f063c2-303a-4e32-9160-b7350f52e326-kube-api-access-w5gv4\") pod \"openshift-state-metrics-65f78d5c66-v9wg4\" (UID: \"d2f063c2-303a-4e32-9160-b7350f52e326\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.518493 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.516957 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0aec3eb-4721-4b55-aa25-9e01a2c4c887-node-exporter-tls\") pod \"node-exporter-l47wj\" (UID: \"a0aec3eb-4721-4b55-aa25-9e01a2c4c887\") " pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.518493 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.518107 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm5xk\" (UniqueName: \"kubernetes.io/projected/6074c847-b197-46ac-ba34-169b3fe49929-kube-api-access-gm5xk\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:44.580874 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.580835 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" Jun 05 20:32:44.615127 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.615078 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l47wj" Jun 05 20:32:44.628688 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:44.628656 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0aec3eb_4721_4b55_aa25_9e01a2c4c887.slice/crio-23d9f80c2bca4698addaad3b73bd9ea7463c84694ffc8342b4036575069d8fb0 WatchSource:0}: Error finding container 23d9f80c2bca4698addaad3b73bd9ea7463c84694ffc8342b4036575069d8fb0: Status 404 returned error can't find the container with id 23d9f80c2bca4698addaad3b73bd9ea7463c84694ffc8342b4036575069d8fb0 Jun 05 20:32:44.743165 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:44.743133 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4"] Jun 05 20:32:44.749549 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:44.749461 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2f063c2_303a_4e32_9160_b7350f52e326.slice/crio-754c03608c1ae9f651393e6f1800aa6404d5e6090888012d9792c5977fc4c280 WatchSource:0}: Error finding container 754c03608c1ae9f651393e6f1800aa6404d5e6090888012d9792c5977fc4c280: Status 404 returned error can't find the container with id 754c03608c1ae9f651393e6f1800aa6404d5e6090888012d9792c5977fc4c280 Jun 05 20:32:45.003606 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.003517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:45.006738 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.006710 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6074c847-b197-46ac-ba34-169b3fe49929-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2l6fs\" (UID: \"6074c847-b197-46ac-ba34-169b3fe49929\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:45.042672 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.042618 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:32:45.042866 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.042740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" event={"ID":"38b8286f-8961-471b-9e19-0ea772134dc5","Type":"ContainerStarted","Data":"e2bd6edd2ecf84545a9098f007439f34b5c8fe94cb9879f89fc241da4afab584"} Jun 05 20:32:45.043412 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.043234 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:45.044894 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.044823 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l47wj" event={"ID":"a0aec3eb-4721-4b55-aa25-9e01a2c4c887","Type":"ContainerStarted","Data":"23d9f80c2bca4698addaad3b73bd9ea7463c84694ffc8342b4036575069d8fb0"} Jun 05 20:32:45.048841 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.048362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" event={"ID":"d2f063c2-303a-4e32-9160-b7350f52e326","Type":"ContainerStarted","Data":"52b946f8c7f519c6d5c6dd72644ba4937106db8ec10ce5729248e34836dd2789"} Jun 05 20:32:45.048841 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.048415 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" event={"ID":"d2f063c2-303a-4e32-9160-b7350f52e326","Type":"ContainerStarted","Data":"3a1cd9bebc78666a04cce2707a7b7bfe78e5338a9f612755ddef1fac19db8faf"} Jun 05 20:32:45.048841 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.048445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" event={"ID":"d2f063c2-303a-4e32-9160-b7350f52e326","Type":"ContainerStarted","Data":"754c03608c1ae9f651393e6f1800aa6404d5e6090888012d9792c5977fc4c280"} Jun 05 20:32:45.050072 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.050024 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" Jun 05 20:32:45.062743 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.062690 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-l6n46" podStartSLOduration=42.966426264 podStartE2EDuration="46.062671121s" totalImagesPullingTime="3.096244857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:31:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:45.061262171 +0000 UTC m=+269.298929487" watchObservedRunningTime="2026-06-05 20:32:45.062671121 +0000 UTC m=+269.300338437" Jun 05 20:32:45.207247 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.206674 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" Jun 05 20:32:45.633031 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:45.632943 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs"] Jun 05 20:32:45.790607 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:45.789949 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6074c847_b197_46ac_ba34_169b3fe49929.slice/crio-c0b43e6d8c6d9bb111880c900c6993bc324e85b48763f9fd0213f52ceee18b64 WatchSource:0}: Error finding container c0b43e6d8c6d9bb111880c900c6993bc324e85b48763f9fd0213f52ceee18b64: Status 404 returned error can't find the container with id c0b43e6d8c6d9bb111880c900c6993bc324e85b48763f9fd0213f52ceee18b64 Jun 05 20:32:46.053581 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:46.053505 2583 generic.go:356] "Generic (PLEG): container finished" podID="a0aec3eb-4721-4b55-aa25-9e01a2c4c887" containerID="1a42db279cfd2473501070147506a1fe65c62094d21894c1617a662afa426e05" exitCode=0 Jun 05 20:32:46.053709 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:46.053579 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l47wj" event={"ID":"a0aec3eb-4721-4b55-aa25-9e01a2c4c887","Type":"ContainerDied","Data":"1a42db279cfd2473501070147506a1fe65c62094d21894c1617a662afa426e05"} Jun 05 20:32:46.055782 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:46.055759 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" event={"ID":"d2f063c2-303a-4e32-9160-b7350f52e326","Type":"ContainerStarted","Data":"05679a12f9f40783f7b95b99d2506ca0f2f9c54da6c0ec9d9f42c4416657f069"} Jun 05 20:32:46.056914 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:46.056894 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" event={"ID":"6074c847-b197-46ac-ba34-169b3fe49929","Type":"ContainerStarted","Data":"c0b43e6d8c6d9bb111880c900c6993bc324e85b48763f9fd0213f52ceee18b64"} Jun 05 20:32:46.091450 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:46.091398 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-v9wg4" podStartSLOduration=1.130425279 podStartE2EDuration="2.091376395s" totalImagesPullingTime="960.951116ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:46.089676106 +0000 UTC m=+270.327343424" watchObservedRunningTime="2026-06-05 20:32:46.091376395 +0000 UTC m=+270.329043711" Jun 05 20:32:47.063417 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:47.063382 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l47wj" event={"ID":"a0aec3eb-4721-4b55-aa25-9e01a2c4c887","Type":"ContainerStarted","Data":"e72d7a61dcf0c90907a0f1d3b2cbc361f73c0e682558bf716e2f8aecd86bf6d3"} Jun 05 20:32:47.063824 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:47.063464 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l47wj" event={"ID":"a0aec3eb-4721-4b55-aa25-9e01a2c4c887","Type":"ContainerStarted","Data":"151b82e1051dde3a34b2ae66e430a93ba1ab4fa2bc544f014b1761d1b09e0e56"} Jun 05 20:32:47.081735 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:47.081687 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l47wj" podStartSLOduration=2.100798936 podStartE2EDuration="3.081673363s" totalImagesPullingTime="910.853428ms" totalInitContainerRuntime="70.020999ms" isStatefulPod=true podCreationTimestamp="2026-06-05 20:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:47.079839779 +0000 UTC m=+271.317507106" watchObservedRunningTime="2026-06-05 20:32:47.081673363 +0000 UTC m=+271.319340678" Jun 05 20:32:48.069938 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:48.069900 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" event={"ID":"6074c847-b197-46ac-ba34-169b3fe49929","Type":"ContainerStarted","Data":"2b1b5125790d197707e22aad0f64415765e9b967b6468b571355e5f280b209b6"} Jun 05 20:32:48.070358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:48.069956 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" event={"ID":"6074c847-b197-46ac-ba34-169b3fe49929","Type":"ContainerStarted","Data":"edb78b690935d06ae689a0db17316f25d3e3e317ed2e44dc08683abf3d54f562"} Jun 05 20:32:48.070358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:48.069979 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" event={"ID":"6074c847-b197-46ac-ba34-169b3fe49929","Type":"ContainerStarted","Data":"499aa932079ae71ce597c8a25593355be4c5c4b017824ab3698d25a8de7c2699"} Jun 05 20:32:48.088001 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:48.087957 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2l6fs" podStartSLOduration=2.763079587 podStartE2EDuration="4.087941782s" totalImagesPullingTime="1.324862195s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:48.086561888 +0000 UTC m=+272.324229202" watchObservedRunningTime="2026-06-05 20:32:48.087941782 +0000 UTC m=+272.325609098" Jun 05 20:32:49.044475 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.044439 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6"] Jun 05 20:32:49.047841 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.047821 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.049783 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.049763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 20:32:49.049872 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.049822 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tqqhl\"" Jun 05 20:32:49.058888 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.058865 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6"] Jun 05 20:32:49.145314 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.145288 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad84220e-bfc5-43f1-8436-067c10124d2d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.145711 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.145319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfcwv\" (UniqueName: \"kubernetes.io/projected/ad84220e-bfc5-43f1-8436-067c10124d2d-kube-api-access-rfcwv\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.246413 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.246374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad84220e-bfc5-43f1-8436-067c10124d2d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.246413 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.246412 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfcwv\" (UniqueName: \"kubernetes.io/projected/ad84220e-bfc5-43f1-8436-067c10124d2d-kube-api-access-rfcwv\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.249166 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.249132 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad84220e-bfc5-43f1-8436-067c10124d2d-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.254244 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.254218 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfcwv\" (UniqueName: \"kubernetes.io/projected/ad84220e-bfc5-43f1-8436-067c10124d2d-kube-api-access-rfcwv\") pod \"monitoring-plugin-76b68cc874-4vxh6\" (UID: \"ad84220e-bfc5-43f1-8436-067c10124d2d\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.357156 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.357071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:49.484907 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:49.484878 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6"] Jun 05 20:32:49.487925 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:49.487882 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad84220e_bfc5_43f1_8436_067c10124d2d.slice/crio-b3c69fd26f8bd49c4d10aeb4194822e89a8917d27755b7cf2da5070af2dacdf4 WatchSource:0}: Error finding container b3c69fd26f8bd49c4d10aeb4194822e89a8917d27755b7cf2da5070af2dacdf4: Status 404 returned error can't find the container with id b3c69fd26f8bd49c4d10aeb4194822e89a8917d27755b7cf2da5070af2dacdf4 Jun 05 20:32:50.082032 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.081994 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" event={"ID":"ad84220e-bfc5-43f1-8436-067c10124d2d","Type":"ContainerStarted","Data":"b3c69fd26f8bd49c4d10aeb4194822e89a8917d27755b7cf2da5070af2dacdf4"} Jun 05 20:32:50.511422 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.511346 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:32:50.518735 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.518705 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.521169 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.521141 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 20:32:50.521169 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.521155 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bdnvs\"" Jun 05 20:32:50.521418 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.521276 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ob735kvo26ta\"" Jun 05 20:32:50.521418 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.521409 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 20:32:50.522132 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.521933 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 20:32:50.522629 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.522437 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 20:32:50.523685 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523267 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 20:32:50.523685 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523298 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 20:32:50.523685 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523540 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 20:32:50.523685 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523550 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 20:32:50.523917 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523894 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 20:32:50.523994 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.523972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 20:32:50.524383 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.524196 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 20:32:50.524588 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.524551 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 20:32:50.526434 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.525159 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 20:32:50.528507 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.528462 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 20:32:50.531782 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.531766 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 20:32:50.535578 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.535558 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:32:50.662474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662438 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662477 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662720 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662567 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662720 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662607 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662720 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662655 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662872 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662728 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662872 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662773 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662872 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662812 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.662872 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662857 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663035 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662888 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663035 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663035 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663035 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.662993 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663035 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663027 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663240 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663089 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663240 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663240 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtg7f\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663240 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663174 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663237 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.663396 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.663274 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.763905 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763805 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.763905 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763853 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.763905 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtg7f\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.763986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764014 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764080 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764136 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764192 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764173 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764201 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764225 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764249 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764282 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764325 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764352 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764376 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764604 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764413 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.764912 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764886 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.765966 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.765591 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.767066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.766282 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.767066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.766354 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.767066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.766757 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.767066 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.764282 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.767341 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.767136 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.768076 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.768047 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.769513 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.769457 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.770332 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.770305 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771038 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771038 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771149 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771283 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771555 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771514 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.771871 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.771846 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.772376 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.772306 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.775338 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.775296 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.775418 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.775370 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.776002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.775983 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtg7f\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f\") pod \"prometheus-k8s-0\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:50.833168 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:50.833127 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:32:51.073700 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.073673 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:32:51.076385 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:32:51.076364 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dcdeeeb_2e09_48f1_8f5d_dd6da2472a90.slice/crio-cd1a52e970355c299bb8106d0149f65b1f9b9de288586d5e5996e5bead23dc1c WatchSource:0}: Error finding container cd1a52e970355c299bb8106d0149f65b1f9b9de288586d5e5996e5bead23dc1c: Status 404 returned error can't find the container with id cd1a52e970355c299bb8106d0149f65b1f9b9de288586d5e5996e5bead23dc1c Jun 05 20:32:51.087399 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.087371 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" event={"ID":"ad84220e-bfc5-43f1-8436-067c10124d2d","Type":"ContainerStarted","Data":"5e889c1d074fe8b8a943272fce066ed00bc516b5cbb1162e8b3c982344f762b9"} Jun 05 20:32:51.087551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.087524 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:51.088593 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.088573 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"cd1a52e970355c299bb8106d0149f65b1f9b9de288586d5e5996e5bead23dc1c"} Jun 05 20:32:51.092272 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.092255 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" Jun 05 20:32:51.103385 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:51.103343 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-4vxh6" podStartSLOduration=0.605087195 podStartE2EDuration="2.103330643s" totalImagesPullingTime="1.498243448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:51.102214695 +0000 UTC m=+275.339882010" watchObservedRunningTime="2026-06-05 20:32:51.103330643 +0000 UTC m=+275.340997979" Jun 05 20:32:52.094118 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:52.094085 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076"} Jun 05 20:32:53.099588 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:53.099553 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076" exitCode=0 Jun 05 20:32:53.100053 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:53.099638 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076"} Jun 05 20:32:57.117411 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:57.117368 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c"} Jun 05 20:32:57.117791 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:57.117452 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde"} Jun 05 20:32:57.700984 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:32:57.700940 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pm5ml" podUID="733405a4-43d0-4c67-a74c-2667f29c3fb7" Jun 05 20:32:58.122345 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:58.122314 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:32:59.129171 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:59.129137 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362"} Jun 05 20:32:59.129554 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:59.129215 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf"} Jun 05 20:32:59.129554 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:59.129256 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4"} Jun 05 20:32:59.129554 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:59.129294 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerStarted","Data":"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b"} Jun 05 20:32:59.157498 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:32:59.157432 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8372019760000002 podStartE2EDuration="9.157409903s" totalImagesPullingTime="6.301664922s" totalInitContainerRuntime="18.543005ms" isStatefulPod=false podCreationTimestamp="2026-06-05 20:32:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:32:59.153857592 +0000 UTC m=+283.391524907" watchObservedRunningTime="2026-06-05 20:32:59.157409903 +0000 UTC m=+283.395077217" Jun 05 20:33:00.833713 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:00.833680 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:33:01.571402 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:01.571358 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:33:01.573673 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:01.573655 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/733405a4-43d0-4c67-a74c-2667f29c3fb7-metrics-tls\") pod \"dns-default-pm5ml\" (UID: \"733405a4-43d0-4c67-a74c-2667f29c3fb7\") " pod="openshift-dns/dns-default-pm5ml" Jun 05 20:33:01.725102 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:01.725070 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-svhzf\"" Jun 05 20:33:01.733858 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:01.733830 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:33:01.862436 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:01.862343 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pm5ml"] Jun 05 20:33:01.866632 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:33:01.866593 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod733405a4_43d0_4c67_a74c_2667f29c3fb7.slice/crio-fd9b2a9777ddb0b6b21fe93fff48c4eb4078892efd0a298690a460bcd889af47 WatchSource:0}: Error finding container fd9b2a9777ddb0b6b21fe93fff48c4eb4078892efd0a298690a460bcd889af47: Status 404 returned error can't find the container with id fd9b2a9777ddb0b6b21fe93fff48c4eb4078892efd0a298690a460bcd889af47 Jun 05 20:33:02.142593 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:02.142515 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pm5ml" event={"ID":"733405a4-43d0-4c67-a74c-2667f29c3fb7","Type":"ContainerStarted","Data":"fd9b2a9777ddb0b6b21fe93fff48c4eb4078892efd0a298690a460bcd889af47"} Jun 05 20:33:04.155579 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:04.155540 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pm5ml" event={"ID":"733405a4-43d0-4c67-a74c-2667f29c3fb7","Type":"ContainerStarted","Data":"1a366e5718eeafa34462de57d68d5f01015c471014fdfdd0a88a997345858499"} Jun 05 20:33:04.156052 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:04.155597 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pm5ml" event={"ID":"733405a4-43d0-4c67-a74c-2667f29c3fb7","Type":"ContainerStarted","Data":"cdce31ada86d6d54a5c4f1c8f86e3c9677ea398447b57a6d144d401e7147e414"} Jun 05 20:33:04.156052 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:04.155661 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:33:04.171506 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:04.171438 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pm5ml" podStartSLOduration=251.65034344 podStartE2EDuration="4m13.171421648s" totalImagesPullingTime="1.521078208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 20:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:33:04.170141022 +0000 UTC m=+288.407808338" watchObservedRunningTime="2026-06-05 20:33:04.171421648 +0000 UTC m=+288.409089005" Jun 05 20:33:14.161972 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:14.161941 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pm5ml" Jun 05 20:33:16.190537 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:16.190504 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:33:16.190992 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:16.190975 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:33:16.201547 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:16.201527 2583 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 20:33:20.222141 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:20.222105 2583 generic.go:356] "Generic (PLEG): container finished" podID="aa49ea1a-d30e-40ab-a406-53076125dbe8" containerID="decf38e9da1aadaa3c534fecf9aa7e91ab1d411da91ca47780e93a23a2f41050" exitCode=0 Jun 05 20:33:20.222581 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:20.222179 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" event={"ID":"aa49ea1a-d30e-40ab-a406-53076125dbe8","Type":"ContainerDied","Data":"decf38e9da1aadaa3c534fecf9aa7e91ab1d411da91ca47780e93a23a2f41050"} Jun 05 20:33:20.222581 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:20.222524 2583 scope.go:117] "RemoveContainer" containerID="decf38e9da1aadaa3c534fecf9aa7e91ab1d411da91ca47780e93a23a2f41050" Jun 05 20:33:21.227964 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:21.227925 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mpskz" event={"ID":"aa49ea1a-d30e-40ab-a406-53076125dbe8","Type":"ContainerStarted","Data":"bd752245a077ad6b4084ae1f344fd4c731adf35a54d6008c5e47b61ada74368a"} Jun 05 20:33:34.277087 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:34.277052 2583 generic.go:356] "Generic (PLEG): container finished" podID="39a35b7a-a4ec-4599-b2db-01fae8d17e2c" containerID="7098f1718eae431b2112a62279f7de7d5d8d92d41a7a10d9f8199bf148014fcd" exitCode=0 Jun 05 20:33:34.277524 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:34.277128 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-txs7k" event={"ID":"39a35b7a-a4ec-4599-b2db-01fae8d17e2c","Type":"ContainerDied","Data":"7098f1718eae431b2112a62279f7de7d5d8d92d41a7a10d9f8199bf148014fcd"} Jun 05 20:33:34.277524 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:34.277457 2583 scope.go:117] "RemoveContainer" containerID="7098f1718eae431b2112a62279f7de7d5d8d92d41a7a10d9f8199bf148014fcd" Jun 05 20:33:35.283292 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:35.283254 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-896549976-txs7k" event={"ID":"39a35b7a-a4ec-4599-b2db-01fae8d17e2c","Type":"ContainerStarted","Data":"1e8661dbfa107b71420a21fa129a7afd970f992a71cfe97ca97d0c4ff3daf10f"} Jun 05 20:33:35.805668 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:35.805643 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xns9l_42b491bf-f1e3-437f-bb57-0dcf8c59e06e/node-ca/0.log" Jun 05 20:33:36.006761 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:36.006736 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5586557d87-f9rfv_b79a0181-611d-41d5-8b26-39e4a4576963/router/0.log" Jun 05 20:33:36.205651 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:36.205575 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gdxv_7a2affb5-e23f-4b37-b6ba-ec2f75b21005/serve-healthcheck-canary/0.log" Jun 05 20:33:50.833590 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:50.833554 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:33:50.849149 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:50.849123 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:33:51.363060 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:33:51.363035 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:08.848273 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848192 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848453 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="prometheus" containerID="cri-o://7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde" gracePeriod=600 Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848512 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-thanos" containerID="cri-o://1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362" gracePeriod=600 Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848566 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy" containerID="cri-o://8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf" gracePeriod=600 Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848589 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="thanos-sidecar" containerID="cri-o://08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b" gracePeriod=600 Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848548 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-web" containerID="cri-o://ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4" gracePeriod=600 Jun 05 20:34:08.848829 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:08.848575 2583 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="config-reloader" containerID="cri-o://3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c" gracePeriod=600 Jun 05 20:34:09.423893 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423859 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362" exitCode=0 Jun 05 20:34:09.423893 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423883 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf" exitCode=0 Jun 05 20:34:09.423893 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423889 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b" exitCode=0 Jun 05 20:34:09.423893 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423895 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c" exitCode=0 Jun 05 20:34:09.423893 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423900 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde" exitCode=0 Jun 05 20:34:09.424175 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.423926 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362"} Jun 05 20:34:09.424175 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.424008 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf"} Jun 05 20:34:09.424175 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.424035 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b"} Jun 05 20:34:09.424175 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.424060 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c"} Jun 05 20:34:09.424175 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:09.424083 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde"} Jun 05 20:34:10.193324 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.193300 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.252722 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252686 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.252889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252759 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.252889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252787 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.252889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252824 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.252889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252851 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.252889 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252874 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252905 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252929 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252966 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.252991 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253026 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253057 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253090 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253142 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253129 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253154 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtg7f\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253185 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253214 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253251 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253281 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253538 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253307 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle\") pod \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\" (UID: \"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90\") " Jun 05 20:34:10.253804 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253673 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.254177 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253926 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.254177 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253934 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.254177 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.253987 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 20:34:10.254587 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.254531 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.254917 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.254848 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.256087 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.255561 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.257053 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.257010 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.257649 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.257611 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 20:34:10.258042 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258012 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config" (OuterVolumeSpecName: "config") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.258124 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258055 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f" (OuterVolumeSpecName: "kube-api-access-rtg7f") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "kube-api-access-rtg7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 20:34:10.258242 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258220 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 20:34:10.258411 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258386 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.258598 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258551 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out" (OuterVolumeSpecName: "config-out") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 20:34:10.258734 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258689 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.259002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.258967 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.259095 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.259064 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.263417 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.263170 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.263417 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.263234 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.269350 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.269327 2583 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config" (OuterVolumeSpecName: "web-config") pod "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" (UID: "7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 20:34:10.354357 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354327 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354357 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354354 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354365 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354375 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-db\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354384 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354394 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354423 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-web-config\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354432 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354441 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-tls-assets\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354450 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-config-out\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354458 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354466 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354475 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-grpc-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354508 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-metrics-client-ca\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354519 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354527 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354536 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-metrics-client-certs\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354543 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtg7f\" (UniqueName: \"kubernetes.io/projected/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-kube-api-access-rtg7f\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.354551 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354552 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.355023 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.354561 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90-secret-kube-rbac-proxy\") on node \"ip-10-0-133-23.ec2.internal\" DevicePath \"\"" Jun 05 20:34:10.431446 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.431375 2583 generic.go:356] "Generic (PLEG): container finished" podID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerID="ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4" exitCode=0 Jun 05 20:34:10.431573 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.431450 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.431573 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.431445 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4"} Jun 05 20:34:10.431573 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.431546 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90","Type":"ContainerDied","Data":"cd1a52e970355c299bb8106d0149f65b1f9b9de288586d5e5996e5bead23dc1c"} Jun 05 20:34:10.431681 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.431581 2583 scope.go:117] "RemoveContainer" containerID="1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362" Jun 05 20:34:10.439360 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.439314 2583 scope.go:117] "RemoveContainer" containerID="8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf" Jun 05 20:34:10.447208 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.447178 2583 scope.go:117] "RemoveContainer" containerID="ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4" Jun 05 20:34:10.454258 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.454226 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:10.457401 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.455993 2583 scope.go:117] "RemoveContainer" containerID="08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b" Jun 05 20:34:10.460390 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.460368 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:10.464936 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.464919 2583 scope.go:117] "RemoveContainer" containerID="3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c" Jun 05 20:34:10.471116 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.471101 2583 scope.go:117] "RemoveContainer" containerID="7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde" Jun 05 20:34:10.478054 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.478039 2583 scope.go:117] "RemoveContainer" containerID="992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076" Jun 05 20:34:10.481461 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481442 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:10.481750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481734 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-web" Jun 05 20:34:10.481750 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481751 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-web" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481759 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481764 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481780 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="init-config-reloader" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481786 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="init-config-reloader" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481792 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="prometheus" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481799 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="prometheus" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481812 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="thanos-sidecar" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481818 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="thanos-sidecar" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481827 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="config-reloader" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481832 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="config-reloader" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481840 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-thanos" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481844 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-thanos" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481895 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="config-reloader" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481902 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="thanos-sidecar" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481909 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481914 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-thanos" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481921 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="prometheus" Jun 05 20:34:10.481933 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.481925 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" containerName="kube-rbac-proxy-web" Jun 05 20:34:10.484939 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.484920 2583 scope.go:117] "RemoveContainer" containerID="1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362" Jun 05 20:34:10.485184 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.485166 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362\": container with ID starting with 1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362 not found: ID does not exist" containerID="1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362" Jun 05 20:34:10.485224 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485191 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362"} err="failed to get container status \"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362\": rpc error: code = NotFound desc = could not find container \"1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362\": container with ID starting with 1b1179bafed72bcc4b0c53094c95a5da14dd4755ccbdc261cd0262e428784362 not found: ID does not exist" Jun 05 20:34:10.485224 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485219 2583 scope.go:117] "RemoveContainer" containerID="8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf" Jun 05 20:34:10.485457 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.485440 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf\": container with ID starting with 8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf not found: ID does not exist" containerID="8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf" Jun 05 20:34:10.485547 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485466 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf"} err="failed to get container status \"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf\": rpc error: code = NotFound desc = could not find container \"8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf\": container with ID starting with 8e4a8277ab3ae8e591a14b76dbaec540b09dd643ff5d52b41b7dc47c32e45fbf not found: ID does not exist" Jun 05 20:34:10.485547 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485503 2583 scope.go:117] "RemoveContainer" containerID="ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4" Jun 05 20:34:10.485723 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.485707 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4\": container with ID starting with ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4 not found: ID does not exist" containerID="ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4" Jun 05 20:34:10.485781 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485729 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4"} err="failed to get container status \"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4\": rpc error: code = NotFound desc = could not find container \"ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4\": container with ID starting with ae01fd45160323d73ecd18c4ed4a323caf595bf3cc0cec88f7d9be9a6c67c8e4 not found: ID does not exist" Jun 05 20:34:10.485781 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485747 2583 scope.go:117] "RemoveContainer" containerID="08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b" Jun 05 20:34:10.485979 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.485962 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b\": container with ID starting with 08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b not found: ID does not exist" containerID="08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b" Jun 05 20:34:10.486093 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485981 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b"} err="failed to get container status \"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b\": rpc error: code = NotFound desc = could not find container \"08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b\": container with ID starting with 08177be263cf91d4426fb692ce3d230d4e54a683707b2efac32c4614d1fa8e9b not found: ID does not exist" Jun 05 20:34:10.486093 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.485994 2583 scope.go:117] "RemoveContainer" containerID="3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c" Jun 05 20:34:10.486420 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.486381 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c\": container with ID starting with 3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c not found: ID does not exist" containerID="3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c" Jun 05 20:34:10.486558 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.486424 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c"} err="failed to get container status \"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c\": rpc error: code = NotFound desc = could not find container \"3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c\": container with ID starting with 3f06db2b5ebdc1394eb6be289a5cc417913613edf83d2bd7413288949b9ea09c not found: ID does not exist" Jun 05 20:34:10.486558 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.486444 2583 scope.go:117] "RemoveContainer" containerID="7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde" Jun 05 20:34:10.486775 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.486755 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde\": container with ID starting with 7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde not found: ID does not exist" containerID="7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde" Jun 05 20:34:10.486843 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.486777 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde"} err="failed to get container status \"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde\": rpc error: code = NotFound desc = could not find container \"7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde\": container with ID starting with 7c3ff7cc846cb4b045358eb1f03b90bcab97e52b9d416a895a6cc659b7219bde not found: ID does not exist" Jun 05 20:34:10.486843 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.486791 2583 scope.go:117] "RemoveContainer" containerID="992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076" Jun 05 20:34:10.487103 ip-10-0-133-23 kubenswrapper[2583]: E0605 20:34:10.487076 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076\": container with ID starting with 992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076 not found: ID does not exist" containerID="992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076" Jun 05 20:34:10.487164 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.487108 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076"} err="failed to get container status \"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076\": rpc error: code = NotFound desc = could not find container \"992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076\": container with ID starting with 992c82c0033100fba40f3a84a188194a077fcc8611043e76d2eb592008e9a076 not found: ID does not exist" Jun 05 20:34:10.487468 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.487449 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.489884 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.489820 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 20:34:10.489993 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.489821 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 20:34:10.490054 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.489845 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bdnvs\"" Jun 05 20:34:10.490113 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490098 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 20:34:10.490170 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490122 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 20:34:10.490218 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490195 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 20:34:10.490273 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490224 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 20:34:10.490273 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490234 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9ob735kvo26ta\"" Jun 05 20:34:10.490371 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490293 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 20:34:10.490371 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490352 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 20:34:10.490599 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490580 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 20:34:10.490745 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490630 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 20:34:10.490745 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490661 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 20:34:10.490745 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490682 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 20:34:10.490947 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.490840 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 20:34:10.493636 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.493619 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 20:34:10.495163 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.495126 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 20:34:10.501325 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.501304 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:10.557631 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557599 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clmrp\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-kube-api-access-clmrp\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557640 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557744 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.557789 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557784 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557802 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557901 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557930 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557970 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.557992 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558069 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558010 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558337 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558337 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558115 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558337 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558140 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558337 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558169 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.558337 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.558191 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659085 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659085 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659087 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659108 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659224 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659340 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659329 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659361 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659532 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659590 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659613 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.659667 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659668 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659698 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659749 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659776 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659831 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clmrp\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-kube-api-access-clmrp\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659933 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660002 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659961 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.660368 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.660003 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.661778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.660535 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.661778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.660628 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.661778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.659693 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.661778 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.661424 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.662357 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.662333 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663030 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.662727 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663030 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.662901 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663030 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.662969 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663030 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.662998 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663334 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.663159 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.663755 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.663734 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/dc65410b-bc59-4772-8fbd-4312cca9ff86-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.664084 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.664063 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.664629 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.664608 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/dc65410b-bc59-4772-8fbd-4312cca9ff86-config-out\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.665007 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.664991 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.665457 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.665435 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.665510 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.665442 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/dc65410b-bc59-4772-8fbd-4312cca9ff86-web-config\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.670716 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.670696 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clmrp\" (UniqueName: \"kubernetes.io/projected/dc65410b-bc59-4772-8fbd-4312cca9ff86-kube-api-access-clmrp\") pod \"prometheus-k8s-0\" (UID: \"dc65410b-bc59-4772-8fbd-4312cca9ff86\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.797914 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.797884 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:34:10.932787 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:10.932752 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 20:34:10.936672 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:34:10.936625 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc65410b_bc59_4772_8fbd_4312cca9ff86.slice/crio-8569eb888bfcba596cd6b98bed96c23fc5ade2fc9fc4bcc7d9ddf7a67082d077 WatchSource:0}: Error finding container 8569eb888bfcba596cd6b98bed96c23fc5ade2fc9fc4bcc7d9ddf7a67082d077: Status 404 returned error can't find the container with id 8569eb888bfcba596cd6b98bed96c23fc5ade2fc9fc4bcc7d9ddf7a67082d077 Jun 05 20:34:11.439040 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:11.439006 2583 generic.go:356] "Generic (PLEG): container finished" podID="dc65410b-bc59-4772-8fbd-4312cca9ff86" containerID="cc51b77c7032b9e6136cd6eed6645f43b99d1812f216c8a1dd8d3ace7371b315" exitCode=0 Jun 05 20:34:11.439537 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:11.439085 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerDied","Data":"cc51b77c7032b9e6136cd6eed6645f43b99d1812f216c8a1dd8d3ace7371b315"} Jun 05 20:34:11.439537 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:11.439197 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"8569eb888bfcba596cd6b98bed96c23fc5ade2fc9fc4bcc7d9ddf7a67082d077"} Jun 05 20:34:12.243036 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.243001 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90" path="/var/lib/kubelet/pods/7dcdeeeb-2e09-48f1-8f5d-dd6da2472a90/volumes" Jun 05 20:34:12.447378 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447339 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"d6513d0a83046fb1ebb500b6e262b1ae1bbc1598e018df4b52a3a29e0b1bba0a"} Jun 05 20:34:12.447759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447409 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"e7555e773553a4fb835e21dffb6f98104938a9bc9362e3fa7d268b440dc92ab0"} Jun 05 20:34:12.447759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447450 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"b66e16ccc27236a0c2d12830f3fd4d90cac7e9b4da430127b9f63dec5523390c"} Jun 05 20:34:12.447759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447502 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"50fe70e85abed4bb6c37b730f4241564d96d4bb82c6f92e5130dac9f850f98ce"} Jun 05 20:34:12.447759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447533 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"d20063db2a30a933f1bf24a1592e12b799e605321402cf866b67f0c6d0d62452"} Jun 05 20:34:12.447759 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.447557 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"dc65410b-bc59-4772-8fbd-4312cca9ff86","Type":"ContainerStarted","Data":"8c511076e0411ba586664920c113f11fee072b696af959af62aa3d7f41fff225"} Jun 05 20:34:12.474022 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:12.473973 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.4556469659999998 podStartE2EDuration="2.47395606s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.309094ms" isStatefulPod=false podCreationTimestamp="2026-06-05 20:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:34:12.471812648 +0000 UTC m=+356.709480002" watchObservedRunningTime="2026-06-05 20:34:12.47395606 +0000 UTC m=+356.711623401" Jun 05 20:34:15.798251 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:34:15.798209 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:35:10.798131 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:35:10.798087 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:35:10.814197 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:35:10.814168 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:35:11.690456 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:35:11.690432 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 20:38:16.218298 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:38:16.218260 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:38:16.219534 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:38:16.219514 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:41:49.371982 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:49.371895 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jpbpg_7f5319b7-1b84-4521-87c1-2cb5acb0b70b/global-pull-secret-syncer/0.log" Jun 05 20:41:49.440383 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:49.440355 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f8dqn_0a4df144-31a2-45b4-8bbd-fa845f20c9ac/konnectivity-agent/0.log" Jun 05 20:41:49.488658 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:49.488637 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-23.ec2.internal_24874d8ccd17d7eda0c345cccfabff1b/haproxy/0.log" Jun 05 20:41:53.102093 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.102059 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-wlfnn_953a8b85-c9e1-469b-a230-0da7037e725d/cluster-monitoring-operator/0.log" Jun 05 20:41:53.133537 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.133506 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2l6fs_6074c847-b197-46ac-ba34-169b3fe49929/kube-state-metrics/0.log" Jun 05 20:41:53.160062 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.160028 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2l6fs_6074c847-b197-46ac-ba34-169b3fe49929/kube-rbac-proxy-main/0.log" Jun 05 20:41:53.183356 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.183329 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2l6fs_6074c847-b197-46ac-ba34-169b3fe49929/kube-rbac-proxy-self/0.log" Jun 05 20:41:53.242022 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.241995 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-4vxh6_ad84220e-bfc5-43f1-8436-067c10124d2d/monitoring-plugin/0.log" Jun 05 20:41:53.270369 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.270342 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l47wj_a0aec3eb-4721-4b55-aa25-9e01a2c4c887/node-exporter/0.log" Jun 05 20:41:53.293323 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.293301 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l47wj_a0aec3eb-4721-4b55-aa25-9e01a2c4c887/kube-rbac-proxy/0.log" Jun 05 20:41:53.316421 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.316402 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l47wj_a0aec3eb-4721-4b55-aa25-9e01a2c4c887/init-textfile/0.log" Jun 05 20:41:53.512502 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.512407 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-v9wg4_d2f063c2-303a-4e32-9160-b7350f52e326/kube-rbac-proxy-main/0.log" Jun 05 20:41:53.534561 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.534538 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-v9wg4_d2f063c2-303a-4e32-9160-b7350f52e326/kube-rbac-proxy-self/0.log" Jun 05 20:41:53.555954 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.555931 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-v9wg4_d2f063c2-303a-4e32-9160-b7350f52e326/openshift-state-metrics/0.log" Jun 05 20:41:53.599165 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.599143 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/prometheus/0.log" Jun 05 20:41:53.618823 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.618793 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/config-reloader/0.log" Jun 05 20:41:53.641695 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.641667 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/thanos-sidecar/0.log" Jun 05 20:41:53.661751 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.661727 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/kube-rbac-proxy-web/0.log" Jun 05 20:41:53.683307 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.683286 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/kube-rbac-proxy/0.log" Jun 05 20:41:53.704473 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.704450 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/kube-rbac-proxy-thanos/0.log" Jun 05 20:41:53.725460 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.725440 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_dc65410b-bc59-4772-8fbd-4312cca9ff86/init-config-reloader/0.log" Jun 05 20:41:53.752570 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.752548 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v8976_e9517a7e-b651-4f4f-90ff-3661fd89e9b0/prometheus-operator/0.log" Jun 05 20:41:53.770323 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:53.770308 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-v8976_e9517a7e-b651-4f4f-90ff-3661fd89e9b0/kube-rbac-proxy/0.log" Jun 05 20:41:55.768600 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:55.768568 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/2.log" Jun 05 20:41:55.775387 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:55.775364 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-l6n46_38b8286f-8961-471b-9e19-0ea772134dc5/console-operator/3.log" Jun 05 20:41:56.891318 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.891284 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl"] Jun 05 20:41:56.894515 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.894499 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:56.896733 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.896709 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ctcx5\"/\"kube-root-ca.crt\"" Jun 05 20:41:56.896733 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.896740 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ctcx5\"/\"openshift-service-ca.crt\"" Jun 05 20:41:56.897372 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.897357 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ctcx5\"/\"default-dockercfg-k8wct\"" Jun 05 20:41:56.901696 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.901679 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl"] Jun 05 20:41:56.948814 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.948789 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-sys\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:56.948934 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.948825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-proc\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:56.948934 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.948870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-podres\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:56.949055 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.948951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-lib-modules\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:56.949055 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:56.948989 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq29g\" (UniqueName: \"kubernetes.io/projected/edbbcf3a-1f61-4644-92c0-4f32725632f8-kube-api-access-bq29g\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050264 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050229 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-podres\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050428 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050279 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-lib-modules\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050428 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050299 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq29g\" (UniqueName: \"kubernetes.io/projected/edbbcf3a-1f61-4644-92c0-4f32725632f8-kube-api-access-bq29g\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050428 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050319 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-sys\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050428 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050379 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-sys\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050428 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050414 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-lib-modules\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050659 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050435 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-proc\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050659 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050502 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-proc\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.050659 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.050415 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/edbbcf3a-1f61-4644-92c0-4f32725632f8-podres\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.057845 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.057829 2583 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq29g\" (UniqueName: \"kubernetes.io/projected/edbbcf3a-1f61-4644-92c0-4f32725632f8-kube-api-access-bq29g\") pod \"perf-node-gather-daemonset-rmtbl\" (UID: \"edbbcf3a-1f61-4644-92c0-4f32725632f8\") " pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.204899 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.204810 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:57.326566 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.326535 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl"] Jun 05 20:41:57.329549 ip-10-0-133-23 kubenswrapper[2583]: W0605 20:41:57.329510 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podedbbcf3a_1f61_4644_92c0_4f32725632f8.slice/crio-7a52c0850fbac70029219d6fc09dca9e106390b7da7b79fdad5b2551e7277d7e WatchSource:0}: Error finding container 7a52c0850fbac70029219d6fc09dca9e106390b7da7b79fdad5b2551e7277d7e: Status 404 returned error can't find the container with id 7a52c0850fbac70029219d6fc09dca9e106390b7da7b79fdad5b2551e7277d7e Jun 05 20:41:57.500781 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.500695 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pm5ml_733405a4-43d0-4c67-a74c-2667f29c3fb7/dns/0.log" Jun 05 20:41:57.520974 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.520941 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pm5ml_733405a4-43d0-4c67-a74c-2667f29c3fb7/kube-rbac-proxy/0.log" Jun 05 20:41:57.543141 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:57.543105 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4jpnl_a45349a0-f3a3-4247-9c3a-8f3274e82617/dns-node-resolver/0.log" Jun 05 20:41:58.005055 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.005024 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xns9l_42b491bf-f1e3-437f-bb57-0dcf8c59e06e/node-ca/0.log" Jun 05 20:41:58.243628 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.243597 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" event={"ID":"edbbcf3a-1f61-4644-92c0-4f32725632f8","Type":"ContainerStarted","Data":"f92141662bcb4d3741b43c6ce7233b56fb9ed78ca44433f457a13e79699165f9"} Jun 05 20:41:58.243784 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.243641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" event={"ID":"edbbcf3a-1f61-4644-92c0-4f32725632f8","Type":"ContainerStarted","Data":"7a52c0850fbac70029219d6fc09dca9e106390b7da7b79fdad5b2551e7277d7e"} Jun 05 20:41:58.243784 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.243716 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:41:58.262286 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.262205 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" podStartSLOduration=2.262191515 podStartE2EDuration="2.262191515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 20:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 20:41:58.260663426 +0000 UTC m=+822.498330741" watchObservedRunningTime="2026-06-05 20:41:58.262191515 +0000 UTC m=+822.499858830" Jun 05 20:41:58.645568 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.645541 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5586557d87-f9rfv_b79a0181-611d-41d5-8b26-39e4a4576963/router/0.log" Jun 05 20:41:58.948300 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:58.948207 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9gdxv_7a2affb5-e23f-4b37-b6ba-ec2f75b21005/serve-healthcheck-canary/0.log" Jun 05 20:41:59.327399 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:59.327368 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-txs7k_39a35b7a-a4ec-4599-b2db-01fae8d17e2c/insights-operator/1.log" Jun 05 20:41:59.327399 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:59.327396 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-896549976-txs7k_39a35b7a-a4ec-4599-b2db-01fae8d17e2c/insights-operator/0.log" Jun 05 20:41:59.477358 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:59.477332 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncc8t_a0fe8ef4-6932-4d5a-8457-8dcb57b80412/kube-rbac-proxy/0.log" Jun 05 20:41:59.496210 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:59.496186 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncc8t_a0fe8ef4-6932-4d5a-8457-8dcb57b80412/exporter/0.log" Jun 05 20:41:59.520081 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:41:59.520053 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ncc8t_a0fe8ef4-6932-4d5a-8457-8dcb57b80412/extractor/0.log" Jun 05 20:42:03.162379 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:03.162347 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-v8vln_c587ee2a-7736-47e7-b446-fc5d52488402/migrator/0.log" Jun 05 20:42:03.181372 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:03.181345 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-v8vln_c587ee2a-7736-47e7-b446-fc5d52488402/graceful-termination/0.log" Jun 05 20:42:03.437574 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:03.437469 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mpskz_aa49ea1a-d30e-40ab-a406-53076125dbe8/kube-storage-version-migrator-operator/1.log" Jun 05 20:42:03.439081 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:03.439055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mpskz_aa49ea1a-d30e-40ab-a406-53076125dbe8/kube-storage-version-migrator-operator/0.log" Jun 05 20:42:04.256446 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.256417 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ctcx5/perf-node-gather-daemonset-rmtbl" Jun 05 20:42:04.335416 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.335388 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/kube-multus-additional-cni-plugins/0.log" Jun 05 20:42:04.356259 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.356231 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/egress-router-binary-copy/0.log" Jun 05 20:42:04.377724 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.377697 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/cni-plugins/0.log" Jun 05 20:42:04.396495 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.396458 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/bond-cni-plugin/0.log" Jun 05 20:42:04.415700 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.415680 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/routeoverride-cni/0.log" Jun 05 20:42:04.435474 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.435454 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/whereabouts-cni-bincopy/0.log" Jun 05 20:42:04.454398 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.454368 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vt5g9_0e926585-1ea2-42af-9b66-ec370e88a915/whereabouts-cni/0.log" Jun 05 20:42:04.668381 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.668341 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xlrdn_aadebda0-926f-4223-8a6f-501a3a844aec/kube-multus/0.log" Jun 05 20:42:04.686783 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.686756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jlbxb_d68e2a6e-118c-49fa-b506-930b8c693e4a/network-metrics-daemon/0.log" Jun 05 20:42:04.704735 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:04.704714 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-jlbxb_d68e2a6e-118c-49fa-b506-930b8c693e4a/kube-rbac-proxy/0.log" Jun 05 20:42:05.998884 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:05.998773 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/ovn-controller/0.log" Jun 05 20:42:06.017038 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.017012 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/ovn-acl-logging/0.log" Jun 05 20:42:06.047079 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.047030 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/kube-rbac-proxy-node/0.log" Jun 05 20:42:06.073455 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.073414 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 20:42:06.094530 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.094504 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/northd/0.log" Jun 05 20:42:06.115703 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.115679 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/nbdb/0.log" Jun 05 20:42:06.140006 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.139979 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/sbdb/0.log" Jun 05 20:42:06.189735 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:06.189705 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ptlgq_50a0934b-701f-4309-8bfd-59c2a71ec836/ovnkube-controller/0.log" Jun 05 20:42:07.193921 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:07.193836 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hp5s8_8744dc21-1c18-4c48-b085-bfe36b22d704/network-check-target-container/0.log" Jun 05 20:42:08.103527 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:08.103432 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-n76t7_008bf6a0-27ba-4446-b8c8-838a15344737/iptables-alerter/0.log" Jun 05 20:42:08.670986 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:08.670915 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-z4jwz_9e2d01fe-37f2-49f5-82c6-0d005292c03d/tuned/0.log" Jun 05 20:42:11.348718 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:11.348690 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-6kxvt_4c59bf4d-fd25-494b-99ac-6f101744f3cf/service-ca-controller/0.log" Jun 05 20:42:11.796877 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:11.796846 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xw9rw_46e048f0-d77e-43fe-b5f1-0b78670c61db/csi-driver/0.log" Jun 05 20:42:11.817532 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:11.817510 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xw9rw_46e048f0-d77e-43fe-b5f1-0b78670c61db/csi-node-driver-registrar/0.log" Jun 05 20:42:11.837685 ip-10-0-133-23 kubenswrapper[2583]: I0605 20:42:11.837658 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-xw9rw_46e048f0-d77e-43fe-b5f1-0b78670c61db/csi-liveness-probe/0.log"