Jul 29 07:40:43.142034 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 29 07:40:43.142045 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 29 07:40:43.142054 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 29 07:40:43.142355 ip-10-0-137-121 systemd[1]: Failed to start Kubernetes Kubelet. Jul 29 07:40:54.201453 ip-10-0-137-121 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 29 07:40:54.201471 ip-10-0-137-121 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 81f483ed66c748f4bd7ea2e60af82d94 -- Jul 29 07:42:34.577291 ip-10-0-137-121 systemd[1]: Starting Kubernetes Kubelet... Jul 29 07:42:34.974680 ip-10-0-137-121 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 07:42:34.974680 ip-10-0-137-121 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 29 07:42:34.974680 ip-10-0-137-121 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 07:42:34.974680 ip-10-0-137-121 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 29 07:42:34.974680 ip-10-0-137-121 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 29 07:42:34.975449 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.974742 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 29 07:42:34.979279 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979261 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.979279 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979278 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979284 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979287 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979290 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979293 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979296 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979305 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979310 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979313 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979316 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979319 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979322 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979324 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979327 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979329 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979332 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979335 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979338 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979340 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979343 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.979350 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979345 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979348 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979352 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979355 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979358 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979361 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979364 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979367 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979370 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979373 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979375 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979378 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979380 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979383 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979386 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979389 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979392 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979398 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979402 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979405 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.979833 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979408 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979411 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979413 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979416 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979418 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979421 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979424 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979426 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979429 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979431 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979434 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979436 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979439 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979441 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979444 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979447 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979450 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979452 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979455 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979457 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.980367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979460 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979463 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979467 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979470 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979472 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979476 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979479 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979482 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979485 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979488 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979491 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979494 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979497 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979500 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979503 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979505 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979508 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979511 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979514 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979517 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.980861 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979519 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979521 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979524 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979527 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979529 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979531 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979534 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979537 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979540 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979542 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979545 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979548 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979550 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979553 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979555 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979557 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979560 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.979562 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981263 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.981364 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981272 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981276 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981279 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981282 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981286 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981289 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981291 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981295 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981298 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981300 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981303 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981306 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981309 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981311 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981314 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981316 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981319 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981321 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981324 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981328 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.981831 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981330 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981333 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981336 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981339 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981342 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981344 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981347 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981349 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981352 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981355 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981357 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981360 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981363 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981366 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981368 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981373 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981377 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981381 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981383 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981386 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.982367 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981389 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981392 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981395 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981398 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981400 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981403 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981405 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981408 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981411 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981413 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981416 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981419 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981421 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981424 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981426 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981429 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981432 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981435 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981438 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981440 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.982890 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981443 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981445 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981448 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981451 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981453 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981455 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981458 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981460 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981463 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981465 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981468 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981471 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981474 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981476 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981479 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981481 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981485 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981489 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981492 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.983391 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981495 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981498 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981501 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981506 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981509 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981512 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981515 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981517 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981520 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981523 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981526 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981528 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981531 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981533 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981536 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981539 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981541 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981544 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981547 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.983843 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981916 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981921 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981925 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981927 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981930 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981934 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981936 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981939 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981942 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981945 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981949 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981952 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981955 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981959 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981962 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981965 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981968 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981971 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981973 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.984430 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981976 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981978 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981981 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.981984 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982001 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982004 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982007 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982009 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982012 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982015 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982017 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982020 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982022 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982025 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982028 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982030 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982033 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982036 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982040 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.984908 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982042 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982045 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982048 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982051 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982053 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982056 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982058 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982061 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982064 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982067 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982069 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982072 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982074 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982077 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982079 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982082 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982084 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982087 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982090 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982093 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.985399 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982096 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982098 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982102 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982105 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982108 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982111 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982113 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982116 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982118 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982121 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982124 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982127 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982130 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982133 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982136 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982138 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982141 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982143 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982146 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982149 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.985884 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982151 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982154 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982156 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982159 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982162 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982165 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982167 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982170 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982172 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982175 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982177 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982180 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982183 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982185 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982188 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982190 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982193 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982195 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982198 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982200 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.986388 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982202 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982277 2583 flags.go:64] FLAG: --address="0.0.0.0" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982285 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982291 2583 flags.go:64] FLAG: --anonymous-auth="true" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982295 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982304 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982307 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982312 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982316 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982319 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982322 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982325 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982329 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982332 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982334 2583 flags.go:64] FLAG: --cgroup-root="" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982337 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982340 2583 flags.go:64] FLAG: --client-ca-file="" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982343 2583 flags.go:64] FLAG: --cloud-provider="external" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982345 2583 flags.go:64] FLAG: --cluster-dns="[]" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982350 2583 flags.go:64] FLAG: --cluster-domain="" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982353 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982356 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982359 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982363 2583 flags.go:64] FLAG: --container-log-max-files="5" Jul 29 07:42:34.986865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982366 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982369 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982373 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982376 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982379 2583 flags.go:64] FLAG: --contention-profiling="false" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982382 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982385 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982388 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982391 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982395 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982398 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982401 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982403 2583 flags.go:64] FLAG: --enable-load-reader="false" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982406 2583 flags.go:64] FLAG: --enable-server="true" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982412 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982417 2583 flags.go:64] FLAG: --event-burst="100" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982420 2583 flags.go:64] FLAG: --event-qps="50" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982423 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982426 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982429 2583 flags.go:64] FLAG: --eviction-hard="" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982433 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982435 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982438 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982442 2583 flags.go:64] FLAG: --eviction-soft="" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982445 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 29 07:42:34.987458 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982447 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982450 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982453 2583 flags.go:64] FLAG: --experimental-mounter-path="" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982456 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982459 2583 flags.go:64] FLAG: --fail-swap-on="true" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982461 2583 flags.go:64] FLAG: --feature-gates="" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982465 2583 flags.go:64] FLAG: --file-check-frequency="20s" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982468 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982471 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982473 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982476 2583 flags.go:64] FLAG: --healthz-port="10248" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982479 2583 flags.go:64] FLAG: --help="false" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982482 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-137-121.ec2.internal" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982484 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982487 2583 flags.go:64] FLAG: --http-check-frequency="20s" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982490 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982493 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982499 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982502 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982505 2583 flags.go:64] FLAG: --image-service-endpoint="" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982507 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982510 2583 flags.go:64] FLAG: --kube-api-burst="100" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982514 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982517 2583 flags.go:64] FLAG: --kube-api-qps="50" Jul 29 07:42:34.988129 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982520 2583 flags.go:64] FLAG: --kube-reserved="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982523 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982527 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982530 2583 flags.go:64] FLAG: --kubelet-cgroups="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982533 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982536 2583 flags.go:64] FLAG: --lock-file="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982539 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982542 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982545 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982550 2583 flags.go:64] FLAG: --log-json-split-stream="false" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982553 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982555 2583 flags.go:64] FLAG: --log-text-split-stream="false" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982558 2583 flags.go:64] FLAG: --logging-format="text" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982561 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982564 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982567 2583 flags.go:64] FLAG: --manifest-url="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982570 2583 flags.go:64] FLAG: --manifest-url-header="" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982574 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982577 2583 flags.go:64] FLAG: --max-open-files="1000000" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982581 2583 flags.go:64] FLAG: --max-pods="110" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982584 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982587 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982589 2583 flags.go:64] FLAG: --memory-manager-policy="None" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982592 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982595 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 29 07:42:34.988749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982600 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982603 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982611 2583 flags.go:64] FLAG: --node-status-max-images="50" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982614 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982617 2583 flags.go:64] FLAG: --oom-score-adj="-999" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982620 2583 flags.go:64] FLAG: --pod-cidr="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982623 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982629 2583 flags.go:64] FLAG: --pod-manifest-path="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982631 2583 flags.go:64] FLAG: --pod-max-pids="-1" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982634 2583 flags.go:64] FLAG: --pods-per-core="0" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982639 2583 flags.go:64] FLAG: --port="10250" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982642 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982645 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d641f5c6c388d133" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982648 2583 flags.go:64] FLAG: --qos-reserved="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982651 2583 flags.go:64] FLAG: --read-only-port="10255" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982654 2583 flags.go:64] FLAG: --register-node="true" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982657 2583 flags.go:64] FLAG: --register-with-taints="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982661 2583 flags.go:64] FLAG: --registry-burst="10" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982664 2583 flags.go:64] FLAG: --registry-qps="5" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982666 2583 flags.go:64] FLAG: --reserved-cpus="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982669 2583 flags.go:64] FLAG: --reserved-memory="" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982673 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982676 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982679 2583 flags.go:64] FLAG: --rotate-certificates="false" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982682 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 29 07:42:34.989408 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982685 2583 flags.go:64] FLAG: --runonce="false" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982687 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982690 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982693 2583 flags.go:64] FLAG: --seccomp-default="false" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982696 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982699 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982702 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982706 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982709 2583 flags.go:64] FLAG: --storage-driver-password="root" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982712 2583 flags.go:64] FLAG: --storage-driver-secure="false" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982715 2583 flags.go:64] FLAG: --storage-driver-table="stats" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982717 2583 flags.go:64] FLAG: --storage-driver-user="root" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982720 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982724 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982727 2583 flags.go:64] FLAG: --system-cgroups="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982730 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982735 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982740 2583 flags.go:64] FLAG: --tls-cert-file="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982742 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982750 2583 flags.go:64] FLAG: --tls-min-version="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982752 2583 flags.go:64] FLAG: --tls-private-key-file="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982755 2583 flags.go:64] FLAG: --topology-manager-policy="none" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982758 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982761 2583 flags.go:64] FLAG: --topology-manager-scope="container" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982764 2583 flags.go:64] FLAG: --v="2" Jul 29 07:42:34.990056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982767 2583 flags.go:64] FLAG: --version="false" Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982772 2583 flags.go:64] FLAG: --vmodule="" Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982776 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.982779 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982932 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982936 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982940 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982942 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982945 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982948 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982951 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982953 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982955 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982958 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982962 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982965 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982967 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982970 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982972 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982975 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982978 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.990666 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.982980 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983002 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983006 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983012 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983014 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983017 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983020 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983022 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983025 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983028 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983030 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983033 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983035 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983038 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983040 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983043 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983046 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983048 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983052 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.991213 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983056 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983059 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983061 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983064 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983067 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983069 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983073 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983076 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983079 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983082 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983084 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983087 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983089 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983092 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983095 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983103 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983107 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983110 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983112 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983115 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.991673 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983118 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983120 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983123 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983126 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983128 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983131 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983133 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983136 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983145 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983147 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983150 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983152 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983154 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983157 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983159 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983162 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983164 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983167 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983171 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983173 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.992224 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983176 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983180 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983183 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983186 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983188 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983191 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983193 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983196 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983205 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983208 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983210 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983213 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983215 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983219 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983222 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983225 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983227 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983230 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983232 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.992718 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983235 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983237 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983240 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.983242 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.983858 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.991255 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.991271 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.991291 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.991312 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991374 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991379 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991383 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991386 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991390 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991393 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.993222 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991396 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991399 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991402 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991405 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991408 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991411 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991416 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991420 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991423 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991426 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991429 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991432 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991435 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991438 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991440 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991443 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991445 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991448 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991451 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991453 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.993593 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991455 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991458 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991460 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991464 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991466 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991469 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991471 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991474 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991477 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991480 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991482 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991485 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991487 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991490 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991492 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991495 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991499 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991502 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991505 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991509 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.994093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991512 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991515 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991518 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991521 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991524 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991526 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991529 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991532 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991534 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991538 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991541 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991544 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991546 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991550 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991552 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991556 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991559 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991561 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991563 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.994605 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991566 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991569 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991572 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991574 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991577 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991579 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991582 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991584 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991586 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991589 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991592 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991594 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991597 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991600 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991603 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991605 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991608 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991610 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991612 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991615 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.995100 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991617 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991620 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991622 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991625 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991628 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991630 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991633 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991635 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991638 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991641 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991644 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991646 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991649 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991651 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.991656 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 07:42:34.995624 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991784 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991789 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991792 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991795 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991797 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991800 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991803 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991805 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991808 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991810 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991813 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991816 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991819 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991821 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991824 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991826 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991828 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991831 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991833 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991836 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 29 07:42:34.996085 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991839 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991841 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991843 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991846 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991848 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991851 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991854 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991856 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991859 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991862 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991864 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991866 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991869 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991872 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991874 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991876 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991879 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991881 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991884 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991886 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 29 07:42:34.996588 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991889 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991891 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991893 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991896 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991899 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991902 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991904 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991907 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991909 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991912 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991914 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991917 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991919 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991921 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991924 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991927 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991929 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991934 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991938 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 29 07:42:34.997093 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991941 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991944 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991947 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991949 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991952 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991954 2583 feature_gate.go:328] unrecognized feature gate: Example Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991957 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991959 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991963 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991966 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991969 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991971 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991973 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991976 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991978 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991981 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.991983 2583 feature_gate.go:328] unrecognized feature gate: Example2 Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992003 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992008 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 29 07:42:34.997565 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992011 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992014 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992016 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992019 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992021 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992024 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992027 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992029 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992032 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992035 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992037 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992041 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992043 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992046 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992048 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992051 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992054 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992058 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992060 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 29 07:42:34.998066 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992063 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:34.992066 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.992071 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.992192 2583 server.go:962] "Client rotation is on, will bootstrap in background" Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.994313 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.995699 2583 server.go:1019] "Starting client certificate rotation" Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.995814 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.995856 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 29 07:42:34.998534 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:34.998101 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 07:42:35.004702 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.004667 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 29 07:42:35.020240 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.020214 2583 log.go:25] "Validated CRI v1 runtime API" Jul 29 07:42:35.022649 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.022632 2583 log.go:25] "Validated CRI v1 image API" Jul 29 07:42:35.024227 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.024207 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 29 07:42:35.024684 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.024659 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 07:42:35.026721 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.026700 2583 fs.go:135] Filesystem UUIDs: map[12a4f57b-59c8-4fa1-b6dc-354c2fdee5a8:/dev/nvme0n1p4 526f80e0-e2ef-40ba-a19d-45169229f7d5:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 29 07:42:35.026798 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.026720 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 29 07:42:35.031971 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.031857 2583 manager.go:216] Machine: {Timestamp:2026-07-29 07:42:35.030442211 +0000 UTC m=+0.335557073 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098483 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec221d3c03fe9f53a3a9be8b8d95e8b3 SystemUUID:ec221d3c-03fe-9f53-a3a9-be8b8d95e8b3 BootID:81f483ed-66c7-48f4-bd7e-a2e60af82d94 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bd:b7:e0:f5:49 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bd:b7:e0:f5:49 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:d1:0a:7b:3a:aa Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 29 07:42:35.031971 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.031969 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 29 07:42:35.032089 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.032068 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 29 07:42:35.035031 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.035004 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 29 07:42:35.035179 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.035033 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-121.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 29 07:42:35.036321 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.036311 2583 topology_manager.go:138] "Creating topology manager with none policy" Jul 29 07:42:35.036353 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.036324 2583 container_manager_linux.go:309] "Creating device plugin manager" Jul 29 07:42:35.036353 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.036331 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 07:42:35.036974 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.036964 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 29 07:42:35.038254 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.038244 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 29 07:42:35.041269 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041257 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 29 07:42:35.041391 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041381 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 29 07:42:35.041428 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041412 2583 kubelet.go:486] "Attempting to sync node with API server" Jul 29 07:42:35.041428 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041422 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 29 07:42:35.041481 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041438 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 29 07:42:35.041481 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041448 2583 kubelet.go:398] "Adding apiserver pod source" Jul 29 07:42:35.041481 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041458 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 29 07:42:35.041868 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041855 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 07:42:35.041937 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.041875 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 29 07:42:35.044077 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.044039 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 29 07:42:35.045841 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.045821 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 29 07:42:35.045899 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.045858 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 29 07:42:35.046616 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046605 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046622 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046631 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046640 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046651 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046656 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 29 07:42:35.046662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046664 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 29 07:42:35.046814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046669 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 29 07:42:35.046814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046680 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 29 07:42:35.046814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046685 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 29 07:42:35.046814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046693 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 29 07:42:35.046814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.046698 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 29 07:42:35.047589 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.047576 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 29 07:42:35.047589 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.047587 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 29 07:42:35.049148 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.049123 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbz7p" Jul 29 07:42:35.051044 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.051030 2583 server.go:1268] "Started kubelet" Jul 29 07:42:35.051650 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.051126 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 29 07:42:35.051650 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.051117 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 29 07:42:35.051650 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.051232 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 29 07:42:35.051970 ip-10-0-137-121 systemd[1]: Started Kubernetes Kubelet. Jul 29 07:42:35.055196 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.055177 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 29 07:42:35.055514 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.055480 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 29 07:42:35.055514 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.055491 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 29 07:42:35.055670 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.055593 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-121.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 29 07:42:35.057252 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.057235 2583 server.go:310] "Adding debug handlers to kubelet server" Jul 29 07:42:35.057842 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.057787 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 29 07:42:35.059368 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.059352 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xbz7p" Jul 29 07:42:35.062202 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.061318 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-121.ec2.internal.18c6b2dac96d563c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-121.ec2.internal,UID:ip-10-0-137-121.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-121.ec2.internal,},FirstTimestamp:2026-07-29 07:42:35.050980924 +0000 UTC m=+0.356095742,LastTimestamp:2026-07-29 07:42:35.050980924 +0000 UTC m=+0.356095742,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-121.ec2.internal,}" Jul 29 07:42:35.065207 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.065187 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 29 07:42:35.065207 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.065204 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 29 07:42:35.065377 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.065292 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.065961 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.065898 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 29 07:42:35.065961 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.065916 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 29 07:42:35.065961 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.065931 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 29 07:42:35.066161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066092 2583 reconstruct.go:97] "Volume reconstruction finished" Jul 29 07:42:35.066161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066102 2583 reconciler.go:29] "Reconciler: start to sync state" Jul 29 07:42:35.066255 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066224 2583 factory.go:55] Registering systemd factory Jul 29 07:42:35.066255 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066242 2583 factory.go:223] Registration of the systemd container factory successfully Jul 29 07:42:35.066483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066464 2583 factory.go:153] Registering CRI-O factory Jul 29 07:42:35.066483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066483 2583 factory.go:223] Registration of the crio container factory successfully Jul 29 07:42:35.066629 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066536 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 29 07:42:35.066629 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066563 2583 factory.go:103] Registering Raw factory Jul 29 07:42:35.066629 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.066580 2583 manager.go:1196] Started watching for new ooms in manager Jul 29 07:42:35.067077 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.067060 2583 manager.go:349] Starting recovery of all containers Jul 29 07:42:35.067198 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.067171 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 29 07:42:35.067248 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.067179 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-121.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 29 07:42:35.076758 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.076741 2583 manager.go:354] Recovery completed Jul 29 07:42:35.080652 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.080639 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.082727 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.082707 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.082794 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.082743 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.082794 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.082755 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.083363 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.083349 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 29 07:42:35.083363 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.083362 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 29 07:42:35.083491 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.083377 2583 state_mem.go:36] "Initialized new in-memory state store" Jul 29 07:42:35.083491 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.083387 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.084119 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084107 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.084186 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084132 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.084186 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084142 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.084815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084804 2583 policy_none.go:49] "None policy: Start" Jul 29 07:42:35.084852 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084819 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 29 07:42:35.084852 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.084830 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 29 07:42:35.085962 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.085951 2583 policy_none.go:47] "Start" Jul 29 07:42:35.126610 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.126591 2583 manager.go:337] "Starting Device Plugin manager" Jul 29 07:42:35.126733 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.126630 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 29 07:42:35.126733 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.126644 2583 server.go:87] "Starting device plugin registration server" Jul 29 07:42:35.126957 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.126942 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 29 07:42:35.127031 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.126960 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 29 07:42:35.127076 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.127052 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 29 07:42:35.127148 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.127134 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 29 07:42:35.127148 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.127148 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 29 07:42:35.127802 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.127656 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 29 07:42:35.127873 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.127830 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.145349 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.145331 2583 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2615 into the system container \"/system.slice\": " Jul 29 07:42:35.227460 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.227392 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.228432 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.228411 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.228494 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.228450 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.228494 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.228465 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.228494 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.228493 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.234027 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.234005 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.234156 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.234034 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-121.ec2.internal\": node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.250418 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.250379 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 29 07:42:35.251774 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.251758 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 29 07:42:35.251838 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.251795 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 29 07:42:35.251838 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.251817 2583 kubelet.go:2448] "Starting kubelet main sync loop" Jul 29 07:42:35.251924 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.251850 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 29 07:42:35.253902 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.253880 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.254026 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.253914 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 07:42:35.352184 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.352138 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal"] Jul 29 07:42:35.352367 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.352233 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.353952 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.353935 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.354047 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.353962 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.354047 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.354006 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.354047 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.354018 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.355333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.355320 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.355483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.355467 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.355519 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.355509 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.356793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356762 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.356793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356790 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.356793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356793 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.357016 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356818 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.357016 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356830 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.357016 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.356802 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.358389 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.358372 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.358457 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.358409 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 29 07:42:35.359108 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.359091 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientMemory" Jul 29 07:42:35.359212 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.359121 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasNoDiskPressure" Jul 29 07:42:35.359212 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.359136 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeHasSufficientPID" Jul 29 07:42:35.367324 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.367299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.367324 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.367324 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.367457 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.367341 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.382836 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.382808 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.387464 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.387446 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-121.ec2.internal\" not found" node="ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.454979 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.454948 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.468415 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468381 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.468489 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468394 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.468489 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468450 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.468489 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468468 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.468600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468518 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5335f321bbdc98b925d1a74da4b1481d-config\") pod \"kube-apiserver-proxy-ip-10-0-137-121.ec2.internal\" (UID: \"5335f321bbdc98b925d1a74da4b1481d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.468600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.468526 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/98b2f14a2e561079373fe06316702acf-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal\" (UID: \"98b2f14a2e561079373fe06316702acf\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.555865 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.555792 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.656357 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.656323 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.684891 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.684844 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.690497 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.690479 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:35.757304 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.757261 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.857855 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.857783 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.958293 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:35.958255 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:35.994868 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.994837 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 29 07:42:35.995417 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:35.995004 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 29 07:42:36.058985 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:36.058953 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:36.064399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.064366 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 07:37:35 +0000 UTC" deadline="2028-02-11 06:07:52.855687167 +0000 UTC" Jul 29 07:42:36.064468 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.064400 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13486h25m16.791290103s" Jul 29 07:42:36.112340 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.112276 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 07:42:36.159448 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:36.159418 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:36.206875 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:36.206840 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5335f321bbdc98b925d1a74da4b1481d.slice/crio-5a3e81adbb55c006f5af66b257f5b02e3b98dba141dcde46af51dd077a8a439a WatchSource:0}: Error finding container 5a3e81adbb55c006f5af66b257f5b02e3b98dba141dcde46af51dd077a8a439a: Status 404 returned error can't find the container with id 5a3e81adbb55c006f5af66b257f5b02e3b98dba141dcde46af51dd077a8a439a Jul 29 07:42:36.207418 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:36.207396 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98b2f14a2e561079373fe06316702acf.slice/crio-906de1804c1b496f6da03ff9fb1f85fefddd3cd3014629d64781b9638bb43265 WatchSource:0}: Error finding container 906de1804c1b496f6da03ff9fb1f85fefddd3cd3014629d64781b9638bb43265: Status 404 returned error can't find the container with id 906de1804c1b496f6da03ff9fb1f85fefddd3cd3014629d64781b9638bb43265 Jul 29 07:42:36.211560 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.211545 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 07:42:36.255750 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.255694 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerStarted","Data":"906de1804c1b496f6da03ff9fb1f85fefddd3cd3014629d64781b9638bb43265"} Jul 29 07:42:36.256641 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.256614 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"5335f321bbdc98b925d1a74da4b1481d","Type":"ContainerStarted","Data":"5a3e81adbb55c006f5af66b257f5b02e3b98dba141dcde46af51dd077a8a439a"} Jul 29 07:42:36.259767 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:36.259752 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-121.ec2.internal\" not found" Jul 29 07:42:36.330122 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.330094 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 07:42:36.365384 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.365323 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" Jul 29 07:42:36.376379 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.376355 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 07:42:36.378683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.378668 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" Jul 29 07:42:36.386763 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.386744 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 29 07:42:36.462281 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:36.462256 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 07:42:37.042387 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.042295 2583 apiserver.go:52] "Watching apiserver" Jul 29 07:42:37.053768 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.053730 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 29 07:42:37.054476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.054453 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-5ftxh","openshift-network-diagnostics/network-check-target-qcj84","openshift-ovn-kubernetes/ovnkube-node-tf55x","kube-system/konnectivity-agent-zlx8t","kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74","openshift-image-registry/node-ca-pxs5z","openshift-multus/network-metrics-daemon-4bd2w","openshift-network-operator/iptables-alerter-vw24z","kube-system/global-pull-secret-syncer-nkld9","openshift-cluster-node-tuning-operator/tuned-j7bx4","openshift-dns/node-resolver-nbj2c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal","openshift-multus/multus-5dsrt"] Jul 29 07:42:37.056349 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.056321 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.057846 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.057820 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.057943 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.057898 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:37.059441 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.059416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.059682 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.059662 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 29 07:42:37.059802 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.059784 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vjp69\"" Jul 29 07:42:37.059886 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.059663 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.060025 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.060008 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.061887 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.061860 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.062640 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.062619 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.062935 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.062910 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 29 07:42:37.062935 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.062927 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.063487 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.063464 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.064506 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.064478 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 29 07:42:37.064617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.064537 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 29 07:42:37.064800 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.064781 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 29 07:42:37.064897 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.064849 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 29 07:42:37.065567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.065102 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kmxxq\"" Jul 29 07:42:37.065567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.065142 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4chc7\"" Jul 29 07:42:37.065567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.065359 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.065567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.065399 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 29 07:42:37.065567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.065529 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 29 07:42:37.066203 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.066180 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.067220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.066622 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 29 07:42:37.067220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.066729 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 29 07:42:37.067220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.066906 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.067220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.066957 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s5d2f\"" Jul 29 07:42:37.067549 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.067323 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 29 07:42:37.067549 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.067358 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.068269 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.068248 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 29 07:42:37.068269 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.068273 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.068433 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.068249 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.068433 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.068419 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hv24d\"" Jul 29 07:42:37.069356 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.069337 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.069846 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.069826 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.070005 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.069901 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.070299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.070278 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 29 07:42:37.070384 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.070362 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l44s5\"" Jul 29 07:42:37.071438 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.071420 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:37.071541 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.071482 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:37.071862 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.071843 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f9d6h\"" Jul 29 07:42:37.072394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.072360 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 29 07:42:37.074361 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.074335 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.074452 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.074424 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:37.076307 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.076035 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.077057 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077026 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-os-release\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.077164 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077070 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-kubelet\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077164 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077097 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-slash\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077164 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077120 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-var-lib-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-device-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.077333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077234 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-ovn\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-node-log\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077359 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077404 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jwrb\" (UniqueName: \"kubernetes.io/projected/a643efd7-ac92-4543-b6c7-044f07fec66c-kube-api-access-6jwrb\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-registration-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.077483 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077476 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zls5\" (UniqueName: \"kubernetes.io/projected/e8c61488-8296-4e7d-a73f-3e756f469c10-kube-api-access-2zls5\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077524 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-system-cni-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077548 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077573 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-socket-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077588 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83bb885b-b355-449f-a1e4-6eb8248b4f20-agent-certs\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077621 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.077668 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.077864 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077707 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.077864 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077745 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfdnp\" (UniqueName: \"kubernetes.io/projected/a1e7b802-f393-494f-a9f9-7f8098b74ef4-kube-api-access-nfdnp\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.077864 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077797 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-netd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.077864 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077842 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.077864 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4jgl\" (UniqueName: \"kubernetes.io/projected/3c59bd2c-45e6-49ac-a09b-317d1c925582-kube-api-access-f4jgl\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077895 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e7b802-f393-494f-a9f9-7f8098b74ef4-iptables-alerter-script\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077927 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-systemd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.077943 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83bb885b-b355-449f-a1e4-6eb8248b4f20-konnectivity-ca\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078016 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e7b802-f393-494f-a9f9-7f8098b74ef4-host-slash\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.078113 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-netns\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078135 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-config\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-env-overrides\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078207 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a643efd7-ac92-4543-b6c7-044f07fec66c-ovn-node-metrics-cert\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078242 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-cnibin\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.078373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.078555 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078408 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-log-socket\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078555 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078437 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-systemd-units\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078555 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078490 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-etc-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078554 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-script-lib\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078571 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-sys-fs\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.078664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7mng\" (UniqueName: \"kubernetes.io/projected/b24b3083-e417-412b-8217-91dd2d36f4ae-kube-api-access-l7mng\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.078664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078633 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8qrg\" (UniqueName: \"kubernetes.io/projected/20405ff3-1221-47f5-a451-06bf081e038c-kube-api-access-c8qrg\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.078782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078669 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078686 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-bin\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.078782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-etc-selinux\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.078782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24b3083-e417-412b-8217-91dd2d36f4ae-host\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.078782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.078733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24b3083-e417-412b-8217-91dd2d36f4ae-serviceca\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.079901 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.079454 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.079901 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.079780 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.080359 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.080336 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-vfrc2\"" Jul 29 07:42:37.080752 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.080735 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-f6496\"" Jul 29 07:42:37.081091 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.081073 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 29 07:42:37.081175 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.081095 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 29 07:42:37.082813 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.082791 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 29 07:42:37.111748 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.111720 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r9r8l" Jul 29 07:42:37.120767 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.120746 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r9r8l" Jul 29 07:42:37.167377 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.167346 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 29 07:42:37.179536 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179499 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-slash\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-multus\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179563 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-ovn\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-ovn\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-slash\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179662 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-node-log\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179691 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jwrb\" (UniqueName: \"kubernetes.io/projected/a643efd7-ac92-4543-b6c7-044f07fec66c-kube-api-access-6jwrb\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179748 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-kubernetes\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179756 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-node-log\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179769 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-run\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179786 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179906 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179943 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83bb885b-b355-449f-a1e4-6eb8248b4f20-agent-certs\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.179979 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179972 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.180484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.179989 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.180484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180202 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.180577 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180485 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.180625 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180568 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfdnp\" (UniqueName: \"kubernetes.io/projected/a1e7b802-f393-494f-a9f9-7f8098b74ef4-kube-api-access-nfdnp\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.180625 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180616 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.180717 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-conf-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.180717 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180675 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 29 07:42:37.180810 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180789 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538b147a-27aa-47c5-bfaf-2795d513fa29-tmp-dir\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.180870 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180828 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.180870 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180857 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.180975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180884 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cni-binary-copy\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.180975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180912 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-modprobe-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.180975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180940 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83bb885b-b355-449f-a1e4-6eb8248b4f20-konnectivity-ca\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.180975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180911 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-kubelet-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.180975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180969 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-kubelet\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.180998 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-host\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181048 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.181061 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181079 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-netns\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-config\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.181149 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:37.681104629 +0000 UTC m=+2.986219436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:37.181246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181167 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-netns\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181227 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-env-overrides\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181284 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a643efd7-ac92-4543-b6c7-044f07fec66c-ovn-node-metrics-cert\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-var-lib-kubelet\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181337 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-systemd-units\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181368 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-script-lib\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181394 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-sys-fs\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-conf\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181432 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-systemd-units\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181443 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-lib-modules\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181472 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/83bb885b-b355-449f-a1e4-6eb8248b4f20-konnectivity-ca\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-etc-selinux\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181507 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-sys-fs\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181524 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24b3083-e417-412b-8217-91dd2d36f4ae-serviceca\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181555 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181581 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cnibin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181599 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-etc-selinux\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.181617 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181606 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-socket-dir-parent\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181632 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vdws\" (UniqueName: \"kubernetes.io/projected/b2316f24-a4e7-4711-8627-fa30e6a38a97-kube-api-access-6vdws\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181664 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-kubelet\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-var-lib-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181705 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-config\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181720 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-device-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181738 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-kubelet\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181755 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-systemd\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181781 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-kubelet-config\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181792 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-var-lib-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181806 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-dbus\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181854 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-registration-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zls5\" (UniqueName: \"kubernetes.io/projected/e8c61488-8296-4e7d-a73f-3e756f469c10-kube-api-access-2zls5\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181918 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-env-overrides\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181850 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-device-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181916 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.182545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.181966 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-registration-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182002 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-system-cni-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182031 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-etc-kubernetes\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182035 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a643efd7-ac92-4543-b6c7-044f07fec66c-ovnkube-script-lib\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182056 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/538b147a-27aa-47c5-bfaf-2795d513fa29-hosts-file\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182117 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-system-cni-dir\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-socket-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-k8s-cni-cncf-io\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182198 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-bin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182226 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-daemon-config\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182228 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3c59bd2c-45e6-49ac-a09b-317d1c925582-socket-dir\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182253 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-netd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4jgl\" (UniqueName: \"kubernetes.io/projected/3c59bd2c-45e6-49ac-a09b-317d1c925582-kube-api-access-f4jgl\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182362 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e7b802-f393-494f-a9f9-7f8098b74ef4-iptables-alerter-script\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182377 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-netd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182421 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-system-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysconfig\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.183407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182476 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-sys\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182502 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-tmp\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-systemd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e7b802-f393-494f-a9f9-7f8098b74ef4-host-slash\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182585 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-multus-certs\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182613 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct2kp\" (UniqueName: \"kubernetes.io/projected/bcd906c2-9d4e-4344-a02c-7531d5d929ed-kube-api-access-ct2kp\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182640 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-run-systemd\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182665 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-tuned\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182695 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-cnibin\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182720 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a1e7b802-f393-494f-a9f9-7f8098b74ef4-host-slash\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182750 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-netns\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-cnibin\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-log-socket\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182811 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-etc-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182841 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7mng\" (UniqueName: \"kubernetes.io/projected/b24b3083-e417-412b-8217-91dd2d36f4ae-kube-api-access-l7mng\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.184127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8qrg\" (UniqueName: \"kubernetes.io/projected/20405ff3-1221-47f5-a451-06bf081e038c-kube-api-access-c8qrg\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182914 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-os-release\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182934 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a1e7b802-f393-494f-a9f9-7f8098b74ef4-iptables-alerter-script\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrw77\" (UniqueName: \"kubernetes.io/projected/538b147a-27aa-47c5-bfaf-2795d513fa29-kube-api-access-rrw77\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182990 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183019 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-bin\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183023 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-log-socket\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183085 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-etc-openvswitch\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183103 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-cni-bin\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24b3083-e417-412b-8217-91dd2d36f4ae-host\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183152 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/20405ff3-1221-47f5-a451-06bf081e038c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183160 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a643efd7-ac92-4543-b6c7-044f07fec66c-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-os-release\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183204 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-hostroot\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b24b3083-e417-412b-8217-91dd2d36f4ae-host\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183231 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.182236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b24b3083-e417-412b-8217-91dd2d36f4ae-serviceca\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.184793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.183348 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/20405ff3-1221-47f5-a451-06bf081e038c-os-release\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.185417 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.184584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a643efd7-ac92-4543-b6c7-044f07fec66c-ovn-node-metrics-cert\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.185417 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.184697 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/83bb885b-b355-449f-a1e4-6eb8248b4f20-agent-certs\") pod \"konnectivity-agent-zlx8t\" (UID: \"83bb885b-b355-449f-a1e4-6eb8248b4f20\") " pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.188206 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.188185 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jwrb\" (UniqueName: \"kubernetes.io/projected/a643efd7-ac92-4543-b6c7-044f07fec66c-kube-api-access-6jwrb\") pod \"ovnkube-node-tf55x\" (UID: \"a643efd7-ac92-4543-b6c7-044f07fec66c\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.194221 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.194194 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfdnp\" (UniqueName: \"kubernetes.io/projected/a1e7b802-f393-494f-a9f9-7f8098b74ef4-kube-api-access-nfdnp\") pod \"iptables-alerter-vw24z\" (UID: \"a1e7b802-f393-494f-a9f9-7f8098b74ef4\") " pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.195287 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.195259 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zls5\" (UniqueName: \"kubernetes.io/projected/e8c61488-8296-4e7d-a73f-3e756f469c10-kube-api-access-2zls5\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.195388 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.195307 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4jgl\" (UniqueName: \"kubernetes.io/projected/3c59bd2c-45e6-49ac-a09b-317d1c925582-kube-api-access-f4jgl\") pod \"aws-ebs-csi-driver-node-57p74\" (UID: \"3c59bd2c-45e6-49ac-a09b-317d1c925582\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.195388 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.195335 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7mng\" (UniqueName: \"kubernetes.io/projected/b24b3083-e417-412b-8217-91dd2d36f4ae-kube-api-access-l7mng\") pod \"node-ca-pxs5z\" (UID: \"b24b3083-e417-412b-8217-91dd2d36f4ae\") " pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.195576 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.195557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8qrg\" (UniqueName: \"kubernetes.io/projected/20405ff3-1221-47f5-a451-06bf081e038c-kube-api-access-c8qrg\") pod \"multus-additional-cni-plugins-5ftxh\" (UID: \"20405ff3-1221-47f5-a451-06bf081e038c\") " pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.283906 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.283868 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cni-binary-copy\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.283914 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-modprobe-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.283939 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-kubelet\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.283962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-host\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.283986 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284014 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-var-lib-kubelet\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284075 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-conf\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284097 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-lib-modules\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284121 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284142 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cnibin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284155 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-kubelet\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-socket-dir-parent\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284191 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-var-lib-kubelet\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284214 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vdws\" (UniqueName: \"kubernetes.io/projected/b2316f24-a4e7-4711-8627-fa30e6a38a97-kube-api-access-6vdws\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.284238 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284251 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-systemd\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284260 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-host\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284270 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-conf\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-kubelet-config\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-lib-modules\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.284318 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:37.78429772 +0000 UTC m=+3.089412544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-dbus\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cnibin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284369 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-kubelet-config\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-etc-kubernetes\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284427 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/538b147a-27aa-47c5-bfaf-2795d513fa29-hosts-file\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284452 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.284608 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284470 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-etc-kubernetes\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284467 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-socket-dir-parent\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284495 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/af95dd1e-6288-4012-992d-f8f9d2999fd4-dbus\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284513 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-systemd\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284513 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-k8s-cni-cncf-io\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-bin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284563 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/538b147a-27aa-47c5-bfaf-2795d513fa29-hosts-file\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284580 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-k8s-cni-cncf-io\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-daemon-config\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284614 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-bin\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284617 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-cni-binary-copy\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-system-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284669 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysconfig\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284677 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-system-cni-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284693 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-sys\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-tmp\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284746 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-sys\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-multus-certs\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.285528 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284794 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct2kp\" (UniqueName: \"kubernetes.io/projected/bcd906c2-9d4e-4344-a02c-7531d5d929ed-kube-api-access-ct2kp\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284812 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284822 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-multus-certs\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284793 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysconfig\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284835 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-tuned\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284876 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-netns\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284905 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-os-release\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284931 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-sysctl-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284973 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-run-netns\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285054 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-os-release\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.284932 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrw77\" (UniqueName: \"kubernetes.io/projected/538b147a-27aa-47c5-bfaf-2795d513fa29-kube-api-access-rrw77\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285094 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-modprobe-d\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-hostroot\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285134 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-hostroot\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285158 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-multus\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285231 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-kubernetes\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-run\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.286690 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285263 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-host-var-lib-cni-multus\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285292 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-conf-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285321 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-kubernetes\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285345 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-conf-dir\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285374 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538b147a-27aa-47c5-bfaf-2795d513fa29-tmp-dir\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285371 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b2316f24-a4e7-4711-8627-fa30e6a38a97-run\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285434 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bcd906c2-9d4e-4344-a02c-7531d5d929ed-multus-daemon-config\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.287683 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.285841 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/538b147a-27aa-47c5-bfaf-2795d513fa29-tmp-dir\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.288010 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.287988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-tmp\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.288083 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.288049 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b2316f24-a4e7-4711-8627-fa30e6a38a97-etc-tuned\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.292183 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.292158 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:37.292183 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.292186 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:37.292370 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.292201 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:37.292370 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.292277 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:37.792257777 +0000 UTC m=+3.097372598 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:37.294021 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.293946 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrw77\" (UniqueName: \"kubernetes.io/projected/538b147a-27aa-47c5-bfaf-2795d513fa29-kube-api-access-rrw77\") pod \"node-resolver-nbj2c\" (UID: \"538b147a-27aa-47c5-bfaf-2795d513fa29\") " pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.294616 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.294591 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vdws\" (UniqueName: \"kubernetes.io/projected/b2316f24-a4e7-4711-8627-fa30e6a38a97-kube-api-access-6vdws\") pod \"tuned-j7bx4\" (UID: \"b2316f24-a4e7-4711-8627-fa30e6a38a97\") " pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.295011 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.294988 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct2kp\" (UniqueName: \"kubernetes.io/projected/bcd906c2-9d4e-4344-a02c-7531d5d929ed-kube-api-access-ct2kp\") pod \"multus-5dsrt\" (UID: \"bcd906c2-9d4e-4344-a02c-7531d5d929ed\") " pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.369298 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.369249 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pxs5z" Jul 29 07:42:37.381119 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.381091 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:42:37.390342 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.390316 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:42:37.400245 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.400220 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" Jul 29 07:42:37.409376 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.409353 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" Jul 29 07:42:37.418317 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.418295 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vw24z" Jul 29 07:42:37.426288 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.426264 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5dsrt" Jul 29 07:42:37.433124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.433105 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" Jul 29 07:42:37.439900 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.439882 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbj2c" Jul 29 07:42:37.572016 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.571902 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 29 07:42:37.688660 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.688629 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:37.688855 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.688776 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:37.688855 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.688848 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:38.6888316 +0000 UTC m=+3.993946407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:37.789749 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.789716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:37.789916 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.789841 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:37.789916 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.789894 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:38.789881192 +0000 UTC m=+4.094995998 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:37.890481 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:37.890393 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:37.890645 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.890545 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:37.890645 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.890567 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:37.890645 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.890579 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:37.890645 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:37.890645 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:38.890624335 +0000 UTC m=+4.195739158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:38.123812 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.123771 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 07:37:37 +0000 UTC" deadline="2028-02-28 17:03:38.3669263 +0000 UTC" Jul 29 07:42:38.123812 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.123808 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13905h21m0.243123354s" Jul 29 07:42:38.187559 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.187527 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e7b802_f393_494f_a9f9_7f8098b74ef4.slice/crio-5aafea8df7ecdcc5e8fb8494b0c0dffd32e533b0dd8389f430b26396760c600e WatchSource:0}: Error finding container 5aafea8df7ecdcc5e8fb8494b0c0dffd32e533b0dd8389f430b26396760c600e: Status 404 returned error can't find the container with id 5aafea8df7ecdcc5e8fb8494b0c0dffd32e533b0dd8389f430b26396760c600e Jul 29 07:42:38.188556 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.188527 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bb885b_b355_449f_a1e4_6eb8248b4f20.slice/crio-85818c44a15b854e2d6b43f2fae4d423479d668a5a2bfd25050ce1c859c7fbf8 WatchSource:0}: Error finding container 85818c44a15b854e2d6b43f2fae4d423479d668a5a2bfd25050ce1c859c7fbf8: Status 404 returned error can't find the container with id 85818c44a15b854e2d6b43f2fae4d423479d668a5a2bfd25050ce1c859c7fbf8 Jul 29 07:42:38.189940 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.189852 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb24b3083_e417_412b_8217_91dd2d36f4ae.slice/crio-2e40d7ce47a18adda56b55b2fdc900b833e944398ad4b7cbf627b618c0d16676 WatchSource:0}: Error finding container 2e40d7ce47a18adda56b55b2fdc900b833e944398ad4b7cbf627b618c0d16676: Status 404 returned error can't find the container with id 2e40d7ce47a18adda56b55b2fdc900b833e944398ad4b7cbf627b618c0d16676 Jul 29 07:42:38.191470 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.191251 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2316f24_a4e7_4711_8627_fa30e6a38a97.slice/crio-9e17720c523c31376b9ff2c5c0731b106fc7191e4b2c452c59b489ac4c3c3179 WatchSource:0}: Error finding container 9e17720c523c31376b9ff2c5c0731b106fc7191e4b2c452c59b489ac4c3c3179: Status 404 returned error can't find the container with id 9e17720c523c31376b9ff2c5c0731b106fc7191e4b2c452c59b489ac4c3c3179 Jul 29 07:42:38.199043 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.199004 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd906c2_9d4e_4344_a02c_7531d5d929ed.slice/crio-db71970666c9075d320e533c3545f37fe182aab1b81e38bbc8ff3ce539218963 WatchSource:0}: Error finding container db71970666c9075d320e533c3545f37fe182aab1b81e38bbc8ff3ce539218963: Status 404 returned error can't find the container with id db71970666c9075d320e533c3545f37fe182aab1b81e38bbc8ff3ce539218963 Jul 29 07:42:38.199901 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.199874 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538b147a_27aa_47c5_bfaf_2795d513fa29.slice/crio-1a45366beab9dd9ba76a313fef54445bc683d5eca6c422ea8d00ea22d57d33cd WatchSource:0}: Error finding container 1a45366beab9dd9ba76a313fef54445bc683d5eca6c422ea8d00ea22d57d33cd: Status 404 returned error can't find the container with id 1a45366beab9dd9ba76a313fef54445bc683d5eca6c422ea8d00ea22d57d33cd Jul 29 07:42:38.200879 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.200804 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c59bd2c_45e6_49ac_a09b_317d1c925582.slice/crio-488fd3af32f52b247ae847d90e6b8555b74cc91ef6199fb307b8a5f51159dce8 WatchSource:0}: Error finding container 488fd3af32f52b247ae847d90e6b8555b74cc91ef6199fb307b8a5f51159dce8: Status 404 returned error can't find the container with id 488fd3af32f52b247ae847d90e6b8555b74cc91ef6199fb307b8a5f51159dce8 Jul 29 07:42:38.201738 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:42:38.201710 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20405ff3_1221_47f5_a451_06bf081e038c.slice/crio-dee2b93aac0ad480b7a15fb7a93437f23bc5ed0b25866300a5d7c06b7637cac9 WatchSource:0}: Error finding container dee2b93aac0ad480b7a15fb7a93437f23bc5ed0b25866300a5d7c06b7637cac9: Status 404 returned error can't find the container with id dee2b93aac0ad480b7a15fb7a93437f23bc5ed0b25866300a5d7c06b7637cac9 Jul 29 07:42:38.252350 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.252324 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:38.252461 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.252429 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:38.261868 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.261821 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbj2c" event={"ID":"538b147a-27aa-47c5-bfaf-2795d513fa29","Type":"ContainerStarted","Data":"1a45366beab9dd9ba76a313fef54445bc683d5eca6c422ea8d00ea22d57d33cd"} Jul 29 07:42:38.262944 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.262916 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" event={"ID":"3c59bd2c-45e6-49ac-a09b-317d1c925582","Type":"ContainerStarted","Data":"488fd3af32f52b247ae847d90e6b8555b74cc91ef6199fb307b8a5f51159dce8"} Jul 29 07:42:38.264239 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.264217 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" event={"ID":"b2316f24-a4e7-4711-8627-fa30e6a38a97","Type":"ContainerStarted","Data":"9e17720c523c31376b9ff2c5c0731b106fc7191e4b2c452c59b489ac4c3c3179"} Jul 29 07:42:38.265434 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.265397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxs5z" event={"ID":"b24b3083-e417-412b-8217-91dd2d36f4ae","Type":"ContainerStarted","Data":"2e40d7ce47a18adda56b55b2fdc900b833e944398ad4b7cbf627b618c0d16676"} Jul 29 07:42:38.266674 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.266648 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vw24z" event={"ID":"a1e7b802-f393-494f-a9f9-7f8098b74ef4","Type":"ContainerStarted","Data":"5aafea8df7ecdcc5e8fb8494b0c0dffd32e533b0dd8389f430b26396760c600e"} Jul 29 07:42:38.268051 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.268023 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerStarted","Data":"dee2b93aac0ad480b7a15fb7a93437f23bc5ed0b25866300a5d7c06b7637cac9"} Jul 29 07:42:38.269496 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.269471 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dsrt" event={"ID":"bcd906c2-9d4e-4344-a02c-7531d5d929ed","Type":"ContainerStarted","Data":"db71970666c9075d320e533c3545f37fe182aab1b81e38bbc8ff3ce539218963"} Jul 29 07:42:38.270774 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.270751 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"86cf21fa11fb43a7feff5a69e2503f5cbe58c6115d61cef6be52a2cdcc4f12af"} Jul 29 07:42:38.271924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.271889 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zlx8t" event={"ID":"83bb885b-b355-449f-a1e4-6eb8248b4f20","Type":"ContainerStarted","Data":"85818c44a15b854e2d6b43f2fae4d423479d668a5a2bfd25050ce1c859c7fbf8"} Jul 29 07:42:38.697200 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.696843 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:38.697391 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.697369 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:38.697464 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.697452 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:40.697430307 +0000 UTC m=+6.002545127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:38.798581 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.798459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:38.798751 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.798680 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:38.798829 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.798765 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:40.798743068 +0000 UTC m=+6.103857881 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:38.899743 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:38.899699 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:38.899960 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.899942 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:38.900032 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.899969 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:38.900032 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.899983 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:38.900174 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:38.900063 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:40.900026755 +0000 UTC m=+6.205141578 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:39.124146 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.124026 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 07:37:37 +0000 UTC" deadline="2028-04-14 14:41:40.032749422 +0000 UTC" Jul 29 07:42:39.124146 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.124092 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15006h59m0.908662147s" Jul 29 07:42:39.254539 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.254503 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:39.254723 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:39.254662 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:39.255134 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.255112 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:39.255551 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:39.255232 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:39.286868 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.286037 2583 generic.go:356] "Generic (PLEG): container finished" podID="98b2f14a2e561079373fe06316702acf" containerID="7404db1bbbd48c4921f77dc46a9b96afc1eb628745ae81a28417c6f2a45862f2" exitCode=0 Jul 29 07:42:39.286868 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.286427 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerDied","Data":"7404db1bbbd48c4921f77dc46a9b96afc1eb628745ae81a28417c6f2a45862f2"} Jul 29 07:42:39.299135 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:39.299018 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" event={"ID":"5335f321bbdc98b925d1a74da4b1481d","Type":"ContainerStarted","Data":"a71f34633dc37cc30aa86ba137e1a7339c09e78f063174542d85b3781c83a1ab"} Jul 29 07:42:40.253124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.253075 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:40.253630 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.253238 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:40.326161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.326050 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" event={"ID":"98b2f14a2e561079373fe06316702acf","Type":"ContainerStarted","Data":"ffbc72884853854f529d560551baccdd59be411ba7c73a773e314f8b98ea471f"} Jul 29 07:42:40.342416 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.342350 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-121.ec2.internal" podStartSLOduration=4.342323649 podStartE2EDuration="4.342323649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:39.317223939 +0000 UTC m=+4.622338771" watchObservedRunningTime="2026-07-29 07:42:40.342323649 +0000 UTC m=+5.647438471" Jul 29 07:42:40.717448 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.717359 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:40.717638 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.717556 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:40.717638 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.717631 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:44.717608935 +0000 UTC m=+10.022723765 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:40.819559 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.818769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:40.819559 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.818989 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:40.819559 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.819085 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:44.819059929 +0000 UTC m=+10.124174755 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:40.920399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:40.919697 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:40.920399 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.919918 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:40.920399 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.919938 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:40.920399 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.919952 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:40.920399 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:40.920015 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:44.91999428 +0000 UTC m=+10.225109104 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:41.255064 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:41.255030 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:41.255558 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:41.255204 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:41.255636 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:41.255595 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:41.255710 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:41.255689 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:42.252082 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:42.252040 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:42.252301 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:42.252186 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:43.253073 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:43.252850 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:43.253073 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:43.252888 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:43.253073 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:43.252972 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:43.253676 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:43.253451 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:44.252802 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:44.252723 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:44.252972 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.252858 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:44.753257 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:44.753221 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:44.753731 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.753404 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:44.753731 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.753477 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:52.753454807 +0000 UTC m=+18.058569617 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:44.854274 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:44.854150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:44.854435 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.854297 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:44.854435 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.854371 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:52.854348176 +0000 UTC m=+18.159462996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:44.955394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:44.954521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:44.955394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.954715 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:44.955394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.954738 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:44.955394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.954751 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:44.955394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:44.954812 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:42:52.954794733 +0000 UTC m=+18.259909542 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:45.253955 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:45.253924 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:45.254146 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:45.254076 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:45.254455 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:45.254428 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:45.254572 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:45.254531 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:46.252674 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:46.252643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:46.253162 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:46.252770 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:47.254160 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:47.254127 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:47.254598 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:47.254259 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:47.254598 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:47.254312 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:47.254598 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:47.254428 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:48.252120 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:48.252089 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:48.252309 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:48.252217 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:49.252943 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:49.252911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:49.253457 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:49.252911 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:49.253457 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:49.253082 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:49.253457 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:49.253183 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:50.252428 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:50.251945 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:50.252428 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:50.252081 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:51.252803 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:51.252762 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:51.253238 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:51.252917 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:51.253238 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:51.252964 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:51.253238 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:51.253095 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:52.252323 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:52.252282 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:52.252578 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:52.252424 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:52.814651 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:52.814614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:52.815165 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:52.814733 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:52.815165 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:52.814793 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:08.814772702 +0000 UTC m=+34.119887520 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:42:52.915600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:52.915565 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:52.915767 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:52.915699 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:52.915767 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:52.915766 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:08.915750271 +0000 UTC m=+34.220865076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:42:53.016533 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:53.016495 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:53.016707 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.016670 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:42:53.016707 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.016697 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:42:53.016707 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.016709 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:53.016837 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.016774 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:09.0167544 +0000 UTC m=+34.321869227 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:42:53.252162 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:53.252076 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:53.252162 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:53.252071 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:53.252342 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.252216 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:53.252382 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:53.252359 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:54.253024 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:54.252977 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:54.253468 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:54.253113 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:55.253983 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:55.253436 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:55.253983 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:55.253573 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:55.253983 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:55.253608 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:55.253983 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:55.253754 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:56.252192 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:56.252150 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:56.252391 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:56.252280 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:57.252700 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:57.252665 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:57.252700 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:57.252703 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:57.253212 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:57.252821 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:57.253212 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:57.252948 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:58.253055 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.252717 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:42:58.253730 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:58.253144 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:42:58.364303 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.364205 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5dsrt" event={"ID":"bcd906c2-9d4e-4344-a02c-7531d5d929ed","Type":"ContainerStarted","Data":"c277887e3241b10cdaf5eda64fe11823f66c4fbdf4795bf6c50ed23ec5e867fb"} Jul 29 07:42:58.367818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.367782 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"65118cc35515bb6490e04c3263b596cda68b2301cce147d9cd199f9fccde9938"} Jul 29 07:42:58.367983 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.367880 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"ecbdcf9285283b117a073f195ee55d1db39844c8ba873454660a537220dec7a1"} Jul 29 07:42:58.367983 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.367931 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"3ff1abb718ee955f62c95c59cad09c5085342e37726ae4aa9794d8bf02bf4ee0"} Jul 29 07:42:58.367983 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.367981 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"94bceb50847debf97a0cede0c01869ff630d86797f3dd4be6fff4a50de347385"} Jul 29 07:42:58.368148 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.368040 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"b671098822a27cdc2bce4ee8a316f6accdeea2e3d12aea6959bbc68a547de4ac"} Jul 29 07:42:58.368148 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.368068 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"d081ca26efbfcdebc6ed9401628cd7c04715fe93fe1279bc9f94d526fac97a80"} Jul 29 07:42:58.369311 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.369285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zlx8t" event={"ID":"83bb885b-b355-449f-a1e4-6eb8248b4f20","Type":"ContainerStarted","Data":"11029810ffc112df910dd35fc0a8a613ee5a14d40d0d7666aedc25990dfd65bc"} Jul 29 07:42:58.370685 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.370651 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbj2c" event={"ID":"538b147a-27aa-47c5-bfaf-2795d513fa29","Type":"ContainerStarted","Data":"63669fbe00d52817778c3ea1fcbd6566708a9f3cbdba7001ac5da5f706a4c06e"} Jul 29 07:42:58.372380 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.372358 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" event={"ID":"3c59bd2c-45e6-49ac-a09b-317d1c925582","Type":"ContainerStarted","Data":"7ed3b1c5c6744a974cda398f12ab16bad7ba83884b0c9158c4499453fc7a8ab7"} Jul 29 07:42:58.373860 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.373839 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" event={"ID":"b2316f24-a4e7-4711-8627-fa30e6a38a97","Type":"ContainerStarted","Data":"f66913ea70b16694f0e1a6f52578b0718e274b9832c6e62ce31edc86d92f8d93"} Jul 29 07:42:58.375441 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.375423 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pxs5z" event={"ID":"b24b3083-e417-412b-8217-91dd2d36f4ae","Type":"ContainerStarted","Data":"4306729771d2d60331faede4d8d1af353c4294c5a5c6cfce94857385219a5d6b"} Jul 29 07:42:58.377117 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.377089 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="5794e31da43a9504c095177d695c0690fc13fd23876fd2254ea57d6efd4a45c7" exitCode=0 Jul 29 07:42:58.377218 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.377126 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"5794e31da43a9504c095177d695c0690fc13fd23876fd2254ea57d6efd4a45c7"} Jul 29 07:42:58.382667 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.382631 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-121.ec2.internal" podStartSLOduration=22.38261922 podStartE2EDuration="22.38261922s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:40.343223211 +0000 UTC m=+5.648338043" watchObservedRunningTime="2026-07-29 07:42:58.38261922 +0000 UTC m=+23.687734049" Jul 29 07:42:58.382764 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.382697 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5dsrt" podStartSLOduration=4.097031343 podStartE2EDuration="23.382692723s" totalImagesPullingTime="19.28566138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:58.382415978 +0000 UTC m=+23.687530831" watchObservedRunningTime="2026-07-29 07:42:58.382692723 +0000 UTC m=+23.687807550" Jul 29 07:42:58.396828 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.396777 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zlx8t" podStartSLOduration=11.933841839 podStartE2EDuration="23.396762734s" totalImagesPullingTime="11.462920895s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:58.396355838 +0000 UTC m=+23.701470665" watchObservedRunningTime="2026-07-29 07:42:58.396762734 +0000 UTC m=+23.701877560" Jul 29 07:42:58.433943 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.433888 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pxs5z" podStartSLOduration=4.194918099 podStartE2EDuration="23.433863876s" totalImagesPullingTime="19.238945777s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:58.433686752 +0000 UTC m=+23.738801579" watchObservedRunningTime="2026-07-29 07:42:58.433863876 +0000 UTC m=+23.738978702" Jul 29 07:42:58.450074 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.450013 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-j7bx4" podStartSLOduration=4.205327328 podStartE2EDuration="23.449977716s" totalImagesPullingTime="19.244650388s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:58.449797491 +0000 UTC m=+23.754912324" watchObservedRunningTime="2026-07-29 07:42:58.449977716 +0000 UTC m=+23.755092543" Jul 29 07:42:58.467310 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.467258 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nbj2c" podStartSLOduration=4.236737667 podStartE2EDuration="23.467243194s" totalImagesPullingTime="19.230505527s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:58.467047985 +0000 UTC m=+23.772162811" watchObservedRunningTime="2026-07-29 07:42:58.467243194 +0000 UTC m=+23.772358022" Jul 29 07:42:58.975307 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:58.975276 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 29 07:42:59.141087 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.140947 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T07:42:58.975296907Z","UUID":"7bbdc37c-b643-443a-8a13-68496173bedc","Handler":null,"Name":"","Endpoint":""} Jul 29 07:42:59.142590 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.142567 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 29 07:42:59.142717 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.142613 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 29 07:42:59.252529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.252451 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:42:59.252681 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.252451 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:42:59.252681 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:59.252593 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:42:59.252785 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:42:59.252692 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:42:59.381407 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.381370 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" event={"ID":"3c59bd2c-45e6-49ac-a09b-317d1c925582","Type":"ContainerStarted","Data":"04aa7a6864ac0393c6bf50fbd1adafe4a643476fd6d08a8bccca70e2194ac76e"} Jul 29 07:42:59.382837 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.382802 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vw24z" event={"ID":"a1e7b802-f393-494f-a9f9-7f8098b74ef4","Type":"ContainerStarted","Data":"1fcc8686b39dfc15a0ea2b508f66e53b4532557c81d0c2a2b9fa2c40565c5af1"} Jul 29 07:42:59.397964 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:42:59.397919 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vw24z" podStartSLOduration=5.156307013 podStartE2EDuration="24.397904293s" totalImagesPullingTime="19.24159728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:42:59.39733264 +0000 UTC m=+24.702447467" watchObservedRunningTime="2026-07-29 07:42:59.397904293 +0000 UTC m=+24.703019119" Jul 29 07:43:00.252281 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:00.252201 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:00.252414 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:00.252335 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:00.387413 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:00.387170 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" event={"ID":"3c59bd2c-45e6-49ac-a09b-317d1c925582","Type":"ContainerStarted","Data":"edbce3032bc45a1c58ccbe7a07f34e5d99043e4f74d7ae89dcbb8f02f8125d4f"} Jul 29 07:43:00.391183 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:00.391135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"d042c40a40b5ba7b795390791708d64fc34d9591cd30047140a4006d287efd82"} Jul 29 07:43:00.406634 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:00.406581 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-57p74" podStartSLOduration=4.000774333 podStartE2EDuration="25.406562522s" totalImagesPullingTime="21.405788189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:00.404838598 +0000 UTC m=+25.709953425" watchObservedRunningTime="2026-07-29 07:43:00.406562522 +0000 UTC m=+25.711677349" Jul 29 07:43:01.252256 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:01.252225 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:01.252441 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:01.252268 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:01.252441 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:01.252367 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:43:01.252552 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:01.252512 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:43:02.252300 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.252151 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:02.252686 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:02.252387 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:02.401591 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.401553 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" event={"ID":"a643efd7-ac92-4543-b6c7-044f07fec66c","Type":"ContainerStarted","Data":"68fff0e5b46091e75eb90fea98a32ae737fc8cc4f946aa78f3fdbc37cfbfbe98"} Jul 29 07:43:02.401857 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.401838 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:02.401978 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.401915 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:02.401978 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.401962 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:02.421477 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.421449 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:02.421768 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.421747 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:02.429955 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.429908 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" podStartSLOduration=8.129858643 podStartE2EDuration="27.429894431s" totalImagesPullingTime="19.300035788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:02.429365275 +0000 UTC m=+27.734480104" watchObservedRunningTime="2026-07-29 07:43:02.429894431 +0000 UTC m=+27.735009237" Jul 29 07:43:02.702053 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.702020 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:43:02.703238 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:02.703208 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:43:03.252735 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:03.252697 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:03.253701 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:03.252847 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:43:03.253701 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:03.253179 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:03.253701 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:03.253311 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:43:03.404372 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:03.404341 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 07:43:04.252975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.252785 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:04.253452 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:04.253055 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:04.281985 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.281959 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qcj84"] Jul 29 07:43:04.285046 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.284978 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkld9"] Jul 29 07:43:04.285160 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.285142 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:04.285276 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:04.285250 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:43:04.285739 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.285714 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bd2w"] Jul 29 07:43:04.285840 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.285817 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:04.286026 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:04.285931 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:43:04.408545 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.408501 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerStarted","Data":"834f20b94e09eb3cfd9fe9c0fd45aa568b1f81a24913b8abf82b071bb532cfa9"} Jul 29 07:43:04.408717 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:04.408560 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:04.408717 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:04.408664 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:05.412399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:05.412366 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="834f20b94e09eb3cfd9fe9c0fd45aa568b1f81a24913b8abf82b071bb532cfa9" exitCode=0 Jul 29 07:43:05.412800 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:05.412422 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"834f20b94e09eb3cfd9fe9c0fd45aa568b1f81a24913b8abf82b071bb532cfa9"} Jul 29 07:43:06.252577 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.252537 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:06.252756 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.252588 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:06.252756 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.252544 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:06.252756 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:06.252670 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:43:06.252928 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:06.252771 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:43:06.252928 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:06.252848 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:06.417115 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.417075 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="46789d84f9bd8675c07e733415c75ec458727264672e80e9d58faef6a76d612a" exitCode=0 Jul 29 07:43:06.417453 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.417134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"46789d84f9bd8675c07e733415c75ec458727264672e80e9d58faef6a76d612a"} Jul 29 07:43:06.908567 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.908521 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:43:06.908756 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.908700 2583 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 29 07:43:06.909290 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:06.909192 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zlx8t" Jul 29 07:43:07.421736 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:07.421502 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="f62fe318a254c4dbd949f4f3fe3fe2d2a92405ccea22def67114f95b9e4b0cd9" exitCode=0 Jul 29 07:43:07.422124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:07.421591 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"f62fe318a254c4dbd949f4f3fe3fe2d2a92405ccea22def67114f95b9e4b0cd9"} Jul 29 07:43:08.252056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:08.252026 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:08.252056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:08.252046 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:08.252308 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:08.252037 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:08.252308 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.252153 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4bd2w" podUID="e8c61488-8296-4e7d-a73f-3e756f469c10" Jul 29 07:43:08.252308 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.252199 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nkld9" podUID="af95dd1e-6288-4012-992d-f8f9d2999fd4" Jul 29 07:43:08.252308 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.252255 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-qcj84" podUID="cabbe9eb-1109-4ef1-a720-07c152da1d00" Jul 29 07:43:08.830916 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:08.830876 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:08.831562 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.831025 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:43:08.831562 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.831104 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:40.831083692 +0000 UTC m=+66.136198500 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 29 07:43:08.932418 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:08.932363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:08.932589 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.932579 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 29 07:43:08.932658 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:08.932651 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret podName:af95dd1e-6288-4012-992d-f8f9d2999fd4 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:40.932624179 +0000 UTC m=+66.237738998 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret") pod "global-pull-secret-syncer-nkld9" (UID: "af95dd1e-6288-4012-992d-f8f9d2999fd4") : object "kube-system"/"original-pull-secret" not registered Jul 29 07:43:09.033298 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:09.033258 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:09.033531 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:09.033504 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 29 07:43:09.033531 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:09.033533 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 29 07:43:09.033705 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:09.033544 2583 projected.go:196] Error preparing data for projected volume kube-api-access-75wf8 for pod openshift-network-diagnostics/network-check-target-qcj84: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:43:09.033705 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:09.033599 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8 podName:cabbe9eb-1109-4ef1-a720-07c152da1d00 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:41.03358602 +0000 UTC m=+66.338700825 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-75wf8" (UniqueName: "kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8") pod "network-check-target-qcj84" (UID: "cabbe9eb-1109-4ef1-a720-07c152da1d00") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 29 07:43:09.980670 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:09.980637 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-121.ec2.internal" event="NodeReady" Jul 29 07:43:09.981202 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:09.980806 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 29 07:43:10.022679 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.022649 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nztc4"] Jul 29 07:43:10.027611 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.027583 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4cpfl"] Jul 29 07:43:10.027763 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.027719 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.030118 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.030095 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 29 07:43:10.030251 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.030153 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mtm9v\"" Jul 29 07:43:10.030251 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.030209 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 29 07:43:10.030957 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.030936 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.033143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.033120 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 29 07:43:10.033261 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.033161 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 29 07:43:10.033392 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.033372 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xqm2c\"" Jul 29 07:43:10.033489 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.033424 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 29 07:43:10.035406 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.035277 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nztc4"] Jul 29 07:43:10.038181 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.038149 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4cpfl"] Jul 29 07:43:10.143474 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143439 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d43ea3bb-3484-416c-b138-7e0fe1a19a80-cert\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.143672 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143521 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6nkc\" (UniqueName: \"kubernetes.io/projected/9c31fe19-ca22-41fe-a792-cc215e995f33-kube-api-access-d6nkc\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.143672 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.143770 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143705 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c31fe19-ca22-41fe-a792-cc215e995f33-config-volume\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.143770 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143751 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c31fe19-ca22-41fe-a792-cc215e995f33-tmp-dir\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.143872 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.143770 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6w99\" (UniqueName: \"kubernetes.io/projected/d43ea3bb-3484-416c-b138-7e0fe1a19a80-kube-api-access-p6w99\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.244609 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244562 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6nkc\" (UniqueName: \"kubernetes.io/projected/9c31fe19-ca22-41fe-a792-cc215e995f33-kube-api-access-d6nkc\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.244804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244625 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.244804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244671 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c31fe19-ca22-41fe-a792-cc215e995f33-config-volume\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.244804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244701 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c31fe19-ca22-41fe-a792-cc215e995f33-tmp-dir\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.244804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244727 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6w99\" (UniqueName: \"kubernetes.io/projected/d43ea3bb-3484-416c-b138-7e0fe1a19a80-kube-api-access-p6w99\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.244804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.244777 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d43ea3bb-3484-416c-b138-7e0fe1a19a80-cert\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.245082 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:10.244829 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:10.245082 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:10.244892 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:10.74487655 +0000 UTC m=+36.049991358 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:10.245190 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.245158 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9c31fe19-ca22-41fe-a792-cc215e995f33-tmp-dir\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.245364 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.245343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9c31fe19-ca22-41fe-a792-cc215e995f33-config-volume\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.249570 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.249544 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d43ea3bb-3484-416c-b138-7e0fe1a19a80-cert\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.252569 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.252540 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:10.252569 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.252558 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:10.252747 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.252558 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:10.255188 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255166 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 07:43:10.255402 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255386 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 29 07:43:10.255475 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255413 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6nkc\" (UniqueName: \"kubernetes.io/projected/9c31fe19-ca22-41fe-a792-cc215e995f33-kube-api-access-d6nkc\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.255693 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255671 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rqth\"" Jul 29 07:43:10.255808 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255724 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 07:43:10.255962 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.255947 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 29 07:43:10.256051 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.256028 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6ztq\"" Jul 29 07:43:10.256829 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.256804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6w99\" (UniqueName: \"kubernetes.io/projected/d43ea3bb-3484-416c-b138-7e0fe1a19a80-kube-api-access-p6w99\") pod \"ingress-canary-4cpfl\" (UID: \"d43ea3bb-3484-416c-b138-7e0fe1a19a80\") " pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.346427 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.346394 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4cpfl" Jul 29 07:43:10.749767 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:10.749730 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:10.749959 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:10.749913 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:10.750051 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:10.750004 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:11.749974295 +0000 UTC m=+37.055089099 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:11.544609 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:11.544403 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4cpfl"] Jul 29 07:43:11.756981 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:11.756944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:11.757129 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:11.757110 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:11.757189 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:11.757180 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:13.757162314 +0000 UTC m=+39.062277140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:12.434818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:12.434775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4cpfl" event={"ID":"d43ea3bb-3484-416c-b138-7e0fe1a19a80","Type":"ContainerStarted","Data":"b58022e273a3e6d39d917bcfd044fbfb468d706ae73d78b851ccfab76efc012b"} Jul 29 07:43:12.438133 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:12.438104 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="cf607230e4f122df1d22618cfb16924b6c76ee9124d76b95192cec2f0708fa2b" exitCode=0 Jul 29 07:43:12.438279 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:12.438147 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"cf607230e4f122df1d22618cfb16924b6c76ee9124d76b95192cec2f0708fa2b"} Jul 29 07:43:13.444287 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:13.444248 2583 generic.go:356] "Generic (PLEG): container finished" podID="20405ff3-1221-47f5-a451-06bf081e038c" containerID="04579be015ea5d70b92da03046a8bc10696c4af25ab0a2d35204f90bdae32984" exitCode=0 Jul 29 07:43:13.444724 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:13.444316 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerDied","Data":"04579be015ea5d70b92da03046a8bc10696c4af25ab0a2d35204f90bdae32984"} Jul 29 07:43:13.775313 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:13.775271 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:13.775498 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:13.775409 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:13.775498 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:13.775466 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:17.775453392 +0000 UTC m=+43.080568196 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:14.449035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:14.448762 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4cpfl" event={"ID":"d43ea3bb-3484-416c-b138-7e0fe1a19a80","Type":"ContainerStarted","Data":"315f482b93b47c8aa0063fdca6971eb9964989e1028bcc4f0c04418447abfbd4"} Jul 29 07:43:14.452312 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:14.452289 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" event={"ID":"20405ff3-1221-47f5-a451-06bf081e038c","Type":"ContainerStarted","Data":"061d5cf3ad8d0239edb7830f8008071dc544d1d8c52b510cf4b9dc0279f8221f"} Jul 29 07:43:14.464850 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:14.464791 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4cpfl" podStartSLOduration=1.969429126 podStartE2EDuration="4.464768971s" totalImagesPullingTime="2.495339845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:14.464561414 +0000 UTC m=+39.769676242" watchObservedRunningTime="2026-07-29 07:43:14.464768971 +0000 UTC m=+39.769883799" Jul 29 07:43:14.485780 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:14.485725 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5ftxh" podStartSLOduration=8.872165007 podStartE2EDuration="39.485710353s" totalImagesPullingTime="30.613545346s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:14.484211856 +0000 UTC m=+39.789326682" watchObservedRunningTime="2026-07-29 07:43:14.485710353 +0000 UTC m=+39.790825179" Jul 29 07:43:17.807570 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:17.807525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:17.808159 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:17.807703 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:17.808159 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:17.807800 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:25.80778071 +0000 UTC m=+51.112895519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:25.861696 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:25.861655 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:25.862210 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:25.861812 2583 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 29 07:43:25.862210 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:25.861905 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls podName:9c31fe19-ca22-41fe-a792-cc215e995f33 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:41.861887478 +0000 UTC m=+67.167002287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls") pod "dns-default-nztc4" (UID: "9c31fe19-ca22-41fe-a792-cc215e995f33") : secret "dns-default-metrics-tls" not found Jul 29 07:43:26.058732 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.058699 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m"] Jul 29 07:43:26.082767 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.082730 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m"] Jul 29 07:43:26.082918 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.082829 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" Jul 29 07:43:26.087324 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.087300 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 29 07:43:26.088641 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.088618 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-j9fbr\"" Jul 29 07:43:26.088742 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.088629 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 29 07:43:26.160181 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.160061 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c"] Jul 29 07:43:26.186126 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.186091 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-x8tsg"] Jul 29 07:43:26.186278 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.186210 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" Jul 29 07:43:26.188903 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.188876 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rwhc8\"" Jul 29 07:43:26.210194 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.210161 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7b46454f75-rtnrd"] Jul 29 07:43:26.210332 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.210279 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.213673 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.213644 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-gjvk6\"" Jul 29 07:43:26.214124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.214108 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 29 07:43:26.214214 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.214149 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 29 07:43:26.214418 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.214382 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 29 07:43:26.214504 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.214444 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 29 07:43:26.218730 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.218711 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 29 07:43:26.226301 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.226275 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c"] Jul 29 07:43:26.226402 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.226316 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-x8tsg"] Jul 29 07:43:26.226402 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.226335 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b46454f75-rtnrd"] Jul 29 07:43:26.226498 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.226398 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.229968 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.229948 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 29 07:43:26.230105 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230015 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 29 07:43:26.230251 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230235 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 29 07:43:26.230367 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230349 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 29 07:43:26.230435 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230396 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 29 07:43:26.230493 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230396 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qjkn9\"" Jul 29 07:43:26.230493 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.230448 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 29 07:43:26.264315 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.264277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvfh8\" (UniqueName: \"kubernetes.io/projected/72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b-kube-api-access-rvfh8\") pod \"volume-data-source-validator-549c6d54cf-k7p5m\" (UID: \"72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" Jul 29 07:43:26.269094 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.269062 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx"] Jul 29 07:43:26.290240 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.290216 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx"] Jul 29 07:43:26.290381 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.290305 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.292865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.292820 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 29 07:43:26.293008 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.292872 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 29 07:43:26.293008 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.292942 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 29 07:43:26.293008 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.292986 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 29 07:43:26.293137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.293052 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jpj5m\"" Jul 29 07:43:26.364653 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364614 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z62rd\" (UniqueName: \"kubernetes.io/projected/1be2b4b5-0382-4d71-8f94-7d845678a827-kube-api-access-z62rd\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.364823 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.364823 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364690 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-stats-auth\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.364823 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364775 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.364823 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364817 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-tmp\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.364951 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364843 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.364951 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364864 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-default-certificate\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.365050 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364947 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvfh8\" (UniqueName: \"kubernetes.io/projected/72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b-kube-api-access-rvfh8\") pod \"volume-data-source-validator-549c6d54cf-k7p5m\" (UID: \"72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" Jul 29 07:43:26.365050 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.364980 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79jfw\" (UniqueName: \"kubernetes.io/projected/b676ff6a-666d-4afc-9811-2183be83336f-kube-api-access-79jfw\") pod \"network-check-source-7d88cb55d8-g5b9c\" (UID: \"b676ff6a-666d-4afc-9811-2183be83336f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" Jul 29 07:43:26.365050 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.365020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7571a46-e8cd-450b-88ad-befabaa61213-serving-cert\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.365144 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.365082 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-snapshots\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.365144 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.365101 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-service-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.365202 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.365151 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbmbj\" (UniqueName: \"kubernetes.io/projected/e7571a46-e8cd-450b-88ad-befabaa61213-kube-api-access-rbmbj\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.380119 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.380081 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvfh8\" (UniqueName: \"kubernetes.io/projected/72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b-kube-api-access-rvfh8\") pod \"volume-data-source-validator-549c6d54cf-k7p5m\" (UID: \"72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" Jul 29 07:43:26.392589 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.392563 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" Jul 29 07:43:26.465612 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.465585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.465727 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.465623 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-default-certificate\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.465844 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.465824 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/620072be-215b-429c-9a33-a493eef4007f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.466014 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.465970 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79jfw\" (UniqueName: \"kubernetes.io/projected/b676ff6a-666d-4afc-9811-2183be83336f-kube-api-access-79jfw\") pod \"network-check-source-7d88cb55d8-g5b9c\" (UID: \"b676ff6a-666d-4afc-9811-2183be83336f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" Jul 29 07:43:26.466083 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466035 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7571a46-e8cd-450b-88ad-befabaa61213-serving-cert\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.466135 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466076 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-snapshots\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.466135 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-service-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.466229 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbmbj\" (UniqueName: \"kubernetes.io/projected/e7571a46-e8cd-450b-88ad-befabaa61213-kube-api-access-rbmbj\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.466229 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z62rd\" (UniqueName: \"kubernetes.io/projected/1be2b4b5-0382-4d71-8f94-7d845678a827-kube-api-access-z62rd\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.466229 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466205 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds6rs\" (UniqueName: \"kubernetes.io/projected/620072be-215b-429c-9a33-a493eef4007f-kube-api-access-ds6rs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.466362 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466237 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.466362 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466259 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-stats-auth\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.466362 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466300 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.466362 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466340 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/620072be-215b-429c-9a33-a493eef4007f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.466556 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-tmp\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.466801 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.466775 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.467075 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.466945 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 07:43:26.467141 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.467080 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-snapshots\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.467199 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.467143 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:26.96698509 +0000 UTC m=+52.272099899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : secret "router-metrics-certs-default" not found Jul 29 07:43:26.467199 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.467169 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:26.967152855 +0000 UTC m=+52.272267685 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:26.467469 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.467417 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e7571a46-e8cd-450b-88ad-befabaa61213-tmp\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.467870 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.467841 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7571a46-e8cd-450b-88ad-befabaa61213-service-ca-bundle\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.468513 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.468489 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-default-certificate\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.468714 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.468694 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e7571a46-e8cd-450b-88ad-befabaa61213-serving-cert\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.475675 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.475622 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79jfw\" (UniqueName: \"kubernetes.io/projected/b676ff6a-666d-4afc-9811-2183be83336f-kube-api-access-79jfw\") pod \"network-check-source-7d88cb55d8-g5b9c\" (UID: \"b676ff6a-666d-4afc-9811-2183be83336f\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" Jul 29 07:43:26.479711 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.479683 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbmbj\" (UniqueName: \"kubernetes.io/projected/e7571a46-e8cd-450b-88ad-befabaa61213-kube-api-access-rbmbj\") pod \"insights-operator-5885fdb759-x8tsg\" (UID: \"e7571a46-e8cd-450b-88ad-befabaa61213\") " pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.481631 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.481611 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z62rd\" (UniqueName: \"kubernetes.io/projected/1be2b4b5-0382-4d71-8f94-7d845678a827-kube-api-access-z62rd\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.482296 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.482270 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-stats-auth\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.495355 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.495323 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" Jul 29 07:43:26.519691 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.519656 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" Jul 29 07:43:26.542297 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.542269 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m"] Jul 29 07:43:26.545368 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:26.545336 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72e0e1ba_b5a2_414d_a3ca_c666c8f7ba4b.slice/crio-fdb33d8ff26c569d8750b0a82813782622733e292fdb59f85a66ef42da04e9c4 WatchSource:0}: Error finding container fdb33d8ff26c569d8750b0a82813782622733e292fdb59f85a66ef42da04e9c4: Status 404 returned error can't find the container with id fdb33d8ff26c569d8750b0a82813782622733e292fdb59f85a66ef42da04e9c4 Jul 29 07:43:26.567777 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.567738 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/620072be-215b-429c-9a33-a493eef4007f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.567923 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.567880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds6rs\" (UniqueName: \"kubernetes.io/projected/620072be-215b-429c-9a33-a493eef4007f-kube-api-access-ds6rs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.567969 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.567949 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/620072be-215b-429c-9a33-a493eef4007f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.568315 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.568296 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/620072be-215b-429c-9a33-a493eef4007f-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.570776 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.570639 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/620072be-215b-429c-9a33-a493eef4007f-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.578312 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.578285 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds6rs\" (UniqueName: \"kubernetes.io/projected/620072be-215b-429c-9a33-a493eef4007f-kube-api-access-ds6rs\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx\" (UID: \"620072be-215b-429c-9a33-a493eef4007f\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.598406 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.598381 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" Jul 29 07:43:26.657347 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.657308 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c"] Jul 29 07:43:26.660894 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:26.660863 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb676ff6a_666d_4afc_9811_2183be83336f.slice/crio-a29f7a41b43d4d283ecf914f218f83dbd7fc262cdf80695219d5cef4a5baab17 WatchSource:0}: Error finding container a29f7a41b43d4d283ecf914f218f83dbd7fc262cdf80695219d5cef4a5baab17: Status 404 returned error can't find the container with id a29f7a41b43d4d283ecf914f218f83dbd7fc262cdf80695219d5cef4a5baab17 Jul 29 07:43:26.672641 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.672611 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-x8tsg"] Jul 29 07:43:26.674752 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:26.674720 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7571a46_e8cd_450b_88ad_befabaa61213.slice/crio-55c3ae3fea43e3a253decc206736634fe065a1cb1f8564c9840be960a41bfcb7 WatchSource:0}: Error finding container 55c3ae3fea43e3a253decc206736634fe065a1cb1f8564c9840be960a41bfcb7: Status 404 returned error can't find the container with id 55c3ae3fea43e3a253decc206736634fe065a1cb1f8564c9840be960a41bfcb7 Jul 29 07:43:26.764972 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.764942 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx"] Jul 29 07:43:26.767726 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:26.767704 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod620072be_215b_429c_9a33_a493eef4007f.slice/crio-5bf5e942a42b417afed5894d521a860cc419517d18a52b9ca7980f94b4e92635 WatchSource:0}: Error finding container 5bf5e942a42b417afed5894d521a860cc419517d18a52b9ca7980f94b4e92635: Status 404 returned error can't find the container with id 5bf5e942a42b417afed5894d521a860cc419517d18a52b9ca7980f94b4e92635 Jul 29 07:43:26.971422 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.971388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.971833 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:26.971437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:26.971833 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.971582 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:27.97156137 +0000 UTC m=+53.276676179 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:26.971833 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.971582 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 07:43:26.971833 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:26.971626 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:27.971616583 +0000 UTC m=+53.276731404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : secret "router-metrics-certs-default" not found Jul 29 07:43:27.486368 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.486326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" event={"ID":"620072be-215b-429c-9a33-a493eef4007f","Type":"ContainerStarted","Data":"5bf5e942a42b417afed5894d521a860cc419517d18a52b9ca7980f94b4e92635"} Jul 29 07:43:27.487821 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.487785 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" event={"ID":"b676ff6a-666d-4afc-9811-2183be83336f","Type":"ContainerStarted","Data":"a29f7a41b43d4d283ecf914f218f83dbd7fc262cdf80695219d5cef4a5baab17"} Jul 29 07:43:27.489286 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.489220 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" event={"ID":"72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b","Type":"ContainerStarted","Data":"fdb33d8ff26c569d8750b0a82813782622733e292fdb59f85a66ef42da04e9c4"} Jul 29 07:43:27.490716 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.490685 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" event={"ID":"e7571a46-e8cd-450b-88ad-befabaa61213","Type":"ContainerStarted","Data":"55c3ae3fea43e3a253decc206736634fe065a1cb1f8564c9840be960a41bfcb7"} Jul 29 07:43:27.979080 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.979039 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:27.979643 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:27.979092 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:27.979643 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:27.979226 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 07:43:27.979643 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:27.979235 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:29.979205702 +0000 UTC m=+55.284320530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:27.979643 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:27.979283 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:29.979267039 +0000 UTC m=+55.284381868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : secret "router-metrics-certs-default" not found Jul 29 07:43:28.495164 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:28.495126 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" event={"ID":"72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b","Type":"ContainerStarted","Data":"c4e6394074e0acae20343bac43caa7817d2a1974bd3fd9e02b56e391b816df63"} Jul 29 07:43:28.512056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:28.511929 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-k7p5m" podStartSLOduration=0.801883601 podStartE2EDuration="2.511908384s" totalImagesPullingTime="1.710024783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:28.511834757 +0000 UTC m=+53.816949586" watchObservedRunningTime="2026-07-29 07:43:28.511908384 +0000 UTC m=+53.817023214" Jul 29 07:43:29.999276 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:29.999235 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:29.999276 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:29.999277 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:29.999754 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:29.999401 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 07:43:29.999754 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:29.999418 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:33.999398431 +0000 UTC m=+59.304513257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:29.999754 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:29.999439 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:33.999428811 +0000 UTC m=+59.304543630 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : secret "router-metrics-certs-default" not found Jul 29 07:43:31.505448 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.505411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" event={"ID":"620072be-215b-429c-9a33-a493eef4007f","Type":"ContainerStarted","Data":"b45ed189246f8736fea1598888ca759dbc38bde7a5e85eccb68ae02aea603ddb"} Jul 29 07:43:31.507824 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.507634 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" event={"ID":"b676ff6a-666d-4afc-9811-2183be83336f","Type":"ContainerStarted","Data":"38b3209aa9c3332e75d19f43774e55df6ba88601f3518597081533b7767e8920"} Jul 29 07:43:31.510008 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.509946 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" event={"ID":"e7571a46-e8cd-450b-88ad-befabaa61213","Type":"ContainerStarted","Data":"2168e9084f6f79ce7f0e45250b563b91704caa310c391e36c56879be238210e4"} Jul 29 07:43:31.534799 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.534740 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" podStartSLOduration=1.866459654 podStartE2EDuration="5.534718812s" totalImagesPullingTime="3.668259158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:31.533560464 +0000 UTC m=+56.838675317" watchObservedRunningTime="2026-07-29 07:43:31.534718812 +0000 UTC m=+56.839833640" Jul 29 07:43:31.554728 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.554696 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-f9457"] Jul 29 07:43:31.557574 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.557554 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.559744 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.559726 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 29 07:43:31.559894 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.559744 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 29 07:43:31.560161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.560139 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vwln6\"" Jul 29 07:43:31.564968 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.564919 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-g5b9c" podStartSLOduration=1.777881984 podStartE2EDuration="5.564899894s" totalImagesPullingTime="3.78701791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:31.563731076 +0000 UTC m=+56.868845906" watchObservedRunningTime="2026-07-29 07:43:31.564899894 +0000 UTC m=+56.870014723" Jul 29 07:43:31.568485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.568459 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f9457"] Jul 29 07:43:31.591298 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.591234 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" podStartSLOduration=1.8267170350000002 podStartE2EDuration="5.591209814s" totalImagesPullingTime="3.764492779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:31.584399302 +0000 UTC m=+56.889514130" watchObservedRunningTime="2026-07-29 07:43:31.591209814 +0000 UTC m=+56.896324645" Jul 29 07:43:31.614305 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.614266 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e08619-a170-4d5b-831e-fada8f3e32e6-crio-socket\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.614485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.614333 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mht6\" (UniqueName: \"kubernetes.io/projected/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-api-access-5mht6\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.614485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.614400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.614485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.614462 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e08619-a170-4d5b-831e-fada8f3e32e6-data-volume\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.614485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.614483 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715575 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715530 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e08619-a170-4d5b-831e-fada8f3e32e6-data-volume\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715575 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715653 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e08619-a170-4d5b-831e-fada8f3e32e6-crio-socket\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715690 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mht6\" (UniqueName: \"kubernetes.io/projected/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-api-access-5mht6\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715727 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:31.715739 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715761 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f7e08619-a170-4d5b-831e-fada8f3e32e6-crio-socket\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.715831 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:31.715823 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:32.215799798 +0000 UTC m=+57.520914634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : configmap "kube-rbac-proxy" not found Jul 29 07:43:31.716136 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:31.715866 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 07:43:31.716136 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.715930 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f7e08619-a170-4d5b-831e-fada8f3e32e6-data-volume\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:31.716136 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:31.715941 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:32.215924586 +0000 UTC m=+57.521039412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : secret "insights-runtime-extractor-tls" not found Jul 29 07:43:31.724054 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:31.724033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mht6\" (UniqueName: \"kubernetes.io/projected/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-api-access-5mht6\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:32.220214 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.220174 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:32.220394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.220234 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:32.220394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:32.220310 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 07:43:32.220394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:32.220320 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 07:43:32.220394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:32.220370 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:33.220354882 +0000 UTC m=+58.525469703 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : configmap "kube-rbac-proxy" not found Jul 29 07:43:32.220394 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:32.220383 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:33.220377024 +0000 UTC m=+58.525491828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : secret "insights-runtime-extractor-tls" not found Jul 29 07:43:32.704890 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.704802 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fdz84"] Jul 29 07:43:32.706850 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.706834 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.709267 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.709241 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 29 07:43:32.709395 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.709358 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 29 07:43:32.710423 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.710406 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 29 07:43:32.710525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.710455 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 29 07:43:32.710525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.710482 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-67x8t\"" Jul 29 07:43:32.719535 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.719512 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fdz84"] Jul 29 07:43:32.725714 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.725693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-cabundle\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.725796 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.725720 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxhkw\" (UniqueName: \"kubernetes.io/projected/29a5d30c-205c-46a7-b97e-d33c79b34057-kube-api-access-qxhkw\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.725845 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.725816 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-key\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.826268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.826229 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-key\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.826451 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.826372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-cabundle\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.826451 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.826397 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxhkw\" (UniqueName: \"kubernetes.io/projected/29a5d30c-205c-46a7-b97e-d33c79b34057-kube-api-access-qxhkw\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.826939 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.826918 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-cabundle\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.828776 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.828752 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/29a5d30c-205c-46a7-b97e-d33c79b34057-signing-key\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:32.834040 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:32.834013 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxhkw\" (UniqueName: \"kubernetes.io/projected/29a5d30c-205c-46a7-b97e-d33c79b34057-kube-api-access-qxhkw\") pod \"service-ca-658d7b7c78-fdz84\" (UID: \"29a5d30c-205c-46a7-b97e-d33c79b34057\") " pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:33.016177 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.016141 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" Jul 29 07:43:33.139636 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.139602 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-fdz84"] Jul 29 07:43:33.142827 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:33.142801 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29a5d30c_205c_46a7_b97e_d33c79b34057.slice/crio-30d6d51106034a7ae89888468c956f6904534148003a58eef272f92a8a883c28 WatchSource:0}: Error finding container 30d6d51106034a7ae89888468c956f6904534148003a58eef272f92a8a883c28: Status 404 returned error can't find the container with id 30d6d51106034a7ae89888468c956f6904534148003a58eef272f92a8a883c28 Jul 29 07:43:33.229220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.229180 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:33.229431 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.229252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:33.229431 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:33.229336 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 07:43:33.229431 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:33.229364 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 07:43:33.229431 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:33.229409 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:35.229387629 +0000 UTC m=+60.534502434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : configmap "kube-rbac-proxy" not found Jul 29 07:43:33.229431 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:33.229433 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:35.229415609 +0000 UTC m=+60.534530414 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : secret "insights-runtime-extractor-tls" not found Jul 29 07:43:33.515956 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.515915 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" event={"ID":"29a5d30c-205c-46a7-b97e-d33c79b34057","Type":"ContainerStarted","Data":"30d6d51106034a7ae89888468c956f6904534148003a58eef272f92a8a883c28"} Jul 29 07:43:33.527884 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:33.527862 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbj2c_538b147a-27aa-47c5-bfaf-2795d513fa29/dns-node-resolver/0.log" Jul 29 07:43:34.035564 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:34.035529 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:34.035564 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:34.035575 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:34.036065 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:34.035725 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:42.035703347 +0000 UTC m=+67.340818169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:34.036065 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:34.035790 2583 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 29 07:43:34.036065 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:34.035860 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:42.035841411 +0000 UTC m=+67.340956218 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : secret "router-metrics-certs-default" not found Jul 29 07:43:34.423010 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:34.422924 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf55x" Jul 29 07:43:34.528064 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:34.528039 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxs5z_b24b3083-e417-412b-8217-91dd2d36f4ae/node-ca/0.log" Jul 29 07:43:35.128601 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:35.128563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4cpfl_d43ea3bb-3484-416c-b138-7e0fe1a19a80/serve-healthcheck-canary/0.log" Jul 29 07:43:35.245417 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:35.245378 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:35.245575 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:35.245432 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:35.245575 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:35.245486 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 07:43:35.245575 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:35.245518 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 07:43:35.245575 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:35.245533 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:39.245518881 +0000 UTC m=+64.550633685 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : configmap "kube-rbac-proxy" not found Jul 29 07:43:35.245575 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:35.245570 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:39.245556169 +0000 UTC m=+64.550670974 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : secret "insights-runtime-extractor-tls" not found Jul 29 07:43:36.529311 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:36.529266 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" event={"ID":"29a5d30c-205c-46a7-b97e-d33c79b34057","Type":"ContainerStarted","Data":"0b4f301e2ec357668c5315e292bea861b4b1589bde98ebd417470faf2d7710c0"} Jul 29 07:43:36.544646 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:36.544592 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-fdz84" podStartSLOduration=2.252620678 podStartE2EDuration="4.544578744s" totalImagesPullingTime="2.291958066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:36.544451686 +0000 UTC m=+61.849566513" watchObservedRunningTime="2026-07-29 07:43:36.544578744 +0000 UTC m=+61.849693572" Jul 29 07:43:39.284484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:39.284447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:39.284859 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:39.284510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:39.284859 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:39.284573 2583 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 29 07:43:39.284859 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:39.284605 2583 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 29 07:43:39.284859 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:39.284623 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:47.284607802 +0000 UTC m=+72.589722607 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : configmap "kube-rbac-proxy" not found Jul 29 07:43:39.284859 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:39.284676 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls podName:f7e08619-a170-4d5b-831e-fada8f3e32e6 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:47.28465772 +0000 UTC m=+72.589772526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-f9457" (UID: "f7e08619-a170-4d5b-831e-fada8f3e32e6") : secret "insights-runtime-extractor-tls" not found Jul 29 07:43:40.897514 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:40.897474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:43:40.899916 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:40.899897 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 29 07:43:40.908086 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:40.908065 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 29 07:43:40.908167 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:40.908148 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs podName:e8c61488-8296-4e7d-a73f-3e756f469c10 nodeName:}" failed. No retries permitted until 2026-07-29 07:44:44.908125014 +0000 UTC m=+130.213239834 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs") pod "network-metrics-daemon-4bd2w" (UID: "e8c61488-8296-4e7d-a73f-3e756f469c10") : secret "metrics-daemon-secret" not found Jul 29 07:43:40.998897 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:40.998836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:41.001697 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.001676 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 29 07:43:41.012053 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.012031 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/af95dd1e-6288-4012-992d-f8f9d2999fd4-original-pull-secret\") pod \"global-pull-secret-syncer-nkld9\" (UID: \"af95dd1e-6288-4012-992d-f8f9d2999fd4\") " pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:41.100202 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.100166 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:41.103014 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.102957 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wf8\" (UniqueName: \"kubernetes.io/projected/cabbe9eb-1109-4ef1-a720-07c152da1d00-kube-api-access-75wf8\") pod \"network-check-target-qcj84\" (UID: \"cabbe9eb-1109-4ef1-a720-07c152da1d00\") " pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:41.184679 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.184606 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rqth\"" Jul 29 07:43:41.189557 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.189541 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nkld9" Jul 29 07:43:41.193125 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.193107 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:41.330184 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.330153 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-qcj84"] Jul 29 07:43:41.334281 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:41.334253 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabbe9eb_1109_4ef1_a720_07c152da1d00.slice/crio-e9e1262e41a1b3c74e81eb63bf51a6c4d74d471b808915011ccab22acc406412 WatchSource:0}: Error finding container e9e1262e41a1b3c74e81eb63bf51a6c4d74d471b808915011ccab22acc406412: Status 404 returned error can't find the container with id e9e1262e41a1b3c74e81eb63bf51a6c4d74d471b808915011ccab22acc406412 Jul 29 07:43:41.346684 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.346657 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nkld9"] Jul 29 07:43:41.349426 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:41.349397 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf95dd1e_6288_4012_992d_f8f9d2999fd4.slice/crio-e3b29f0e9e68c2c9f064896fcc2a77934c52f7b11cfdb79554c894745c8d4c19 WatchSource:0}: Error finding container e3b29f0e9e68c2c9f064896fcc2a77934c52f7b11cfdb79554c894745c8d4c19: Status 404 returned error can't find the container with id e3b29f0e9e68c2c9f064896fcc2a77934c52f7b11cfdb79554c894745c8d4c19 Jul 29 07:43:41.548158 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.548114 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkld9" event={"ID":"af95dd1e-6288-4012-992d-f8f9d2999fd4","Type":"ContainerStarted","Data":"e3b29f0e9e68c2c9f064896fcc2a77934c52f7b11cfdb79554c894745c8d4c19"} Jul 29 07:43:41.549606 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.549580 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qcj84" event={"ID":"cabbe9eb-1109-4ef1-a720-07c152da1d00","Type":"ContainerStarted","Data":"b214890f72fb8178f4b0ef9c92c2170723684c81319eeb3e0deac50da35ed876"} Jul 29 07:43:41.549722 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.549623 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-qcj84" event={"ID":"cabbe9eb-1109-4ef1-a720-07c152da1d00","Type":"ContainerStarted","Data":"e9e1262e41a1b3c74e81eb63bf51a6c4d74d471b808915011ccab22acc406412"} Jul 29 07:43:41.549779 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.549725 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:43:41.564304 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.564255 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-qcj84" podStartSLOduration=66.564240593 podStartE2EDuration="1m6.564240593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:41.564193321 +0000 UTC m=+66.869308148" watchObservedRunningTime="2026-07-29 07:43:41.564240593 +0000 UTC m=+66.869355420" Jul 29 07:43:41.908573 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.908489 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:41.911300 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:41.911268 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9c31fe19-ca22-41fe-a792-cc215e995f33-metrics-tls\") pod \"dns-default-nztc4\" (UID: \"9c31fe19-ca22-41fe-a792-cc215e995f33\") " pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:42.110614 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.110576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:42.110614 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.110614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:42.110852 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:43:42.110776 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle podName:1be2b4b5-0382-4d71-8f94-7d845678a827 nodeName:}" failed. No retries permitted until 2026-07-29 07:43:58.110752722 +0000 UTC m=+83.415867549 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle") pod "router-default-7b46454f75-rtnrd" (UID: "1be2b4b5-0382-4d71-8f94-7d845678a827") : configmap references non-existent config key: service-ca.crt Jul 29 07:43:42.113659 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.113629 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1be2b4b5-0382-4d71-8f94-7d845678a827-metrics-certs\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:42.143006 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.142973 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mtm9v\"" Jul 29 07:43:42.151465 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.151431 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:42.322735 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.322706 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nztc4"] Jul 29 07:43:42.326161 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:42.326131 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c31fe19_ca22_41fe_a792_cc215e995f33.slice/crio-1f49ffe560e2e9b144f9bd390c66951cd6eeb71bf6994558c5088bf43df1034d WatchSource:0}: Error finding container 1f49ffe560e2e9b144f9bd390c66951cd6eeb71bf6994558c5088bf43df1034d: Status 404 returned error can't find the container with id 1f49ffe560e2e9b144f9bd390c66951cd6eeb71bf6994558c5088bf43df1034d Jul 29 07:43:42.554492 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:42.554452 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nztc4" event={"ID":"9c31fe19-ca22-41fe-a792-cc215e995f33","Type":"ContainerStarted","Data":"1f49ffe560e2e9b144f9bd390c66951cd6eeb71bf6994558c5088bf43df1034d"} Jul 29 07:43:46.571975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.571939 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nkld9" event={"ID":"af95dd1e-6288-4012-992d-f8f9d2999fd4","Type":"ContainerStarted","Data":"cc211810328c2572400739117c5ca7484aa5611602f9f3155894eca6de084f19"} Jul 29 07:43:46.573969 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.573946 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nztc4" event={"ID":"9c31fe19-ca22-41fe-a792-cc215e995f33","Type":"ContainerStarted","Data":"6cb51058ccb8f36d2b444b973ce8b64ef71f386d02c3d981c166a3a645f5ec8f"} Jul 29 07:43:46.574111 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.573983 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nztc4" event={"ID":"9c31fe19-ca22-41fe-a792-cc215e995f33","Type":"ContainerStarted","Data":"95236f2a05db5cc17103fba8bad4691c9ab6f291ee48f7a9a3f08896c4ad26ea"} Jul 29 07:43:46.574173 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.574114 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:46.587665 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.587615 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nkld9" podStartSLOduration=67.088983971 podStartE2EDuration="1m11.587599496s" totalImagesPullingTime="4.498615525s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:46.587033832 +0000 UTC m=+71.892148670" watchObservedRunningTime="2026-07-29 07:43:46.587599496 +0000 UTC m=+71.892714314" Jul 29 07:43:46.603577 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:46.603533 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nztc4" podStartSLOduration=33.087056665 podStartE2EDuration="36.603517691s" totalImagesPullingTime="3.516461026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:46.602490393 +0000 UTC m=+71.907605219" watchObservedRunningTime="2026-07-29 07:43:46.603517691 +0000 UTC m=+71.908632536" Jul 29 07:43:47.361056 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.361018 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:47.361261 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.361073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:47.361587 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.361567 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f7e08619-a170-4d5b-831e-fada8f3e32e6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:47.363523 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.363498 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f7e08619-a170-4d5b-831e-fada8f3e32e6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-f9457\" (UID: \"f7e08619-a170-4d5b-831e-fada8f3e32e6\") " pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:47.471848 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.471812 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vwln6\"" Jul 29 07:43:47.479947 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.479927 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-f9457" Jul 29 07:43:47.608478 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:47.608448 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-f9457"] Jul 29 07:43:47.611464 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:47.611412 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7e08619_a170_4d5b_831e_fada8f3e32e6.slice/crio-d1d0cfa20b2fe30a127e9a408e9d88718d0f9e4ecb0fa7f47b65385ffdf09dba WatchSource:0}: Error finding container d1d0cfa20b2fe30a127e9a408e9d88718d0f9e4ecb0fa7f47b65385ffdf09dba: Status 404 returned error can't find the container with id d1d0cfa20b2fe30a127e9a408e9d88718d0f9e4ecb0fa7f47b65385ffdf09dba Jul 29 07:43:48.582819 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:48.582773 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9457" event={"ID":"f7e08619-a170-4d5b-831e-fada8f3e32e6","Type":"ContainerStarted","Data":"d1d0cfa20b2fe30a127e9a408e9d88718d0f9e4ecb0fa7f47b65385ffdf09dba"} Jul 29 07:43:52.599239 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:52.599196 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9457" event={"ID":"f7e08619-a170-4d5b-831e-fada8f3e32e6","Type":"ContainerStarted","Data":"b39caaf641210cf47e5c43ad29f8b3ba26595d11d07c938dc3461d5202b3468f"} Jul 29 07:43:56.580497 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.580467 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nztc4" Jul 29 07:43:56.618409 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.618365 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9457" event={"ID":"f7e08619-a170-4d5b-831e-fada8f3e32e6","Type":"ContainerStarted","Data":"7cd5bf13cafe1d442d6dbd13297d369a0a201a656cf1baada699cb783f3f6cca"} Jul 29 07:43:56.991852 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.991818 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh"] Jul 29 07:43:56.994139 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.994114 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:56.996783 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.996739 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 29 07:43:56.996783 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.996767 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 29 07:43:56.997657 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.997628 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 29 07:43:56.997657 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:56.997647 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 29 07:43:57.007316 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.007293 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh"] Jul 29 07:43:57.143771 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.143723 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8c6274-83d4-4b02-b298-8c264b03da96-tmp\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.143771 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.143766 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fc8c6274-83d4-4b02-b298-8c264b03da96-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.143982 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.143837 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldnnc\" (UniqueName: \"kubernetes.io/projected/fc8c6274-83d4-4b02-b298-8c264b03da96-kube-api-access-ldnnc\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.244601 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.244514 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fc8c6274-83d4-4b02-b298-8c264b03da96-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.244601 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.244593 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldnnc\" (UniqueName: \"kubernetes.io/projected/fc8c6274-83d4-4b02-b298-8c264b03da96-kube-api-access-ldnnc\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.244826 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.244670 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8c6274-83d4-4b02-b298-8c264b03da96-tmp\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.245161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.245134 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8c6274-83d4-4b02-b298-8c264b03da96-tmp\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.247632 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.247584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fc8c6274-83d4-4b02-b298-8c264b03da96-klusterlet-config\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.258447 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.258421 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldnnc\" (UniqueName: \"kubernetes.io/projected/fc8c6274-83d4-4b02-b298-8c264b03da96-kube-api-access-ldnnc\") pod \"klusterlet-addon-workmgr-5d88875fc7-46xbh\" (UID: \"fc8c6274-83d4-4b02-b298-8c264b03da96\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.305758 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.305724 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:43:57.456669 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.456633 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh"] Jul 29 07:43:57.460537 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:57.460506 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8c6274_83d4_4b02_b298_8c264b03da96.slice/crio-07c7bdacbf7617eb6a3cfbd2f22a310a552ea725250e0e4154bd4d33da8a3219 WatchSource:0}: Error finding container 07c7bdacbf7617eb6a3cfbd2f22a310a552ea725250e0e4154bd4d33da8a3219: Status 404 returned error can't find the container with id 07c7bdacbf7617eb6a3cfbd2f22a310a552ea725250e0e4154bd4d33da8a3219 Jul 29 07:43:57.622761 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:57.622674 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" event={"ID":"fc8c6274-83d4-4b02-b298-8c264b03da96","Type":"ContainerStarted","Data":"07c7bdacbf7617eb6a3cfbd2f22a310a552ea725250e0e4154bd4d33da8a3219"} Jul 29 07:43:58.152112 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:58.152074 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:58.152797 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:58.152769 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1be2b4b5-0382-4d71-8f94-7d845678a827-service-ca-bundle\") pod \"router-default-7b46454f75-rtnrd\" (UID: \"1be2b4b5-0382-4d71-8f94-7d845678a827\") " pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:58.338525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:58.338490 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qjkn9\"" Jul 29 07:43:58.346802 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:58.346777 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:43:59.410022 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.409446 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7b46454f75-rtnrd"] Jul 29 07:43:59.413898 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:43:59.413856 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be2b4b5_0382_4d71_8f94_7d845678a827.slice/crio-6a6e02732db28e4008fa6366fc85d104365b8e67bc249b1420ec47f15abffb2b WatchSource:0}: Error finding container 6a6e02732db28e4008fa6366fc85d104365b8e67bc249b1420ec47f15abffb2b: Status 404 returned error can't find the container with id 6a6e02732db28e4008fa6366fc85d104365b8e67bc249b1420ec47f15abffb2b Jul 29 07:43:59.635307 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.634494 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-f9457" event={"ID":"f7e08619-a170-4d5b-831e-fada8f3e32e6","Type":"ContainerStarted","Data":"c834a5b358704525b324040c43108c80dabcce8f85e9978e1e09351b96865d53"} Jul 29 07:43:59.637261 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.637222 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b46454f75-rtnrd" event={"ID":"1be2b4b5-0382-4d71-8f94-7d845678a827","Type":"ContainerStarted","Data":"9eab7e6a35256d06f9761668ef592fde7327d286fe19784acab1bc9a34dc8e9e"} Jul 29 07:43:59.637391 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.637275 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7b46454f75-rtnrd" event={"ID":"1be2b4b5-0382-4d71-8f94-7d845678a827","Type":"ContainerStarted","Data":"6a6e02732db28e4008fa6366fc85d104365b8e67bc249b1420ec47f15abffb2b"} Jul 29 07:43:59.655327 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.654938 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-f9457" podStartSLOduration=17.085866777 podStartE2EDuration="28.654915402s" totalImagesPullingTime="11.569048625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:43:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:59.652726796 +0000 UTC m=+84.957841623" watchObservedRunningTime="2026-07-29 07:43:59.654915402 +0000 UTC m=+84.960030230" Jul 29 07:43:59.672540 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:43:59.672495 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7b46454f75-rtnrd" podStartSLOduration=33.672478095 podStartE2EDuration="33.672478095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:43:59.671719841 +0000 UTC m=+84.976834668" watchObservedRunningTime="2026-07-29 07:43:59.672478095 +0000 UTC m=+84.977592922" Jul 29 07:44:00.347399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:00.347362 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:44:00.350648 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:00.350599 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:44:00.642514 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:00.642355 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:44:00.643709 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:00.643684 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7b46454f75-rtnrd" Jul 29 07:44:03.492522 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.492482 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm"] Jul 29 07:44:03.494867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.494840 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:03.497375 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.497356 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 29 07:44:03.497551 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.497416 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jrg88\"" Jul 29 07:44:03.505808 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.505788 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm"] Jul 29 07:44:03.599601 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.599563 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cqlfm\" (UID: \"710a79ee-17c2-462a-9fe0-a7fc19c18b2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:03.652671 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.652640 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" event={"ID":"fc8c6274-83d4-4b02-b298-8c264b03da96","Type":"ContainerStarted","Data":"fbc36122784c52561178a0afed3c5743315f4456b38d3e3c7d9f17df62e6b910"} Jul 29 07:44:03.652921 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.652902 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:44:03.654556 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.654538 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" Jul 29 07:44:03.671658 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.671612 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5d88875fc7-46xbh" podStartSLOduration=2.399302316 podStartE2EDuration="7.671596687s" totalImagesPullingTime="5.272294371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:43:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:03.670809179 +0000 UTC m=+88.975924007" watchObservedRunningTime="2026-07-29 07:44:03.671596687 +0000 UTC m=+88.976711513" Jul 29 07:44:03.700450 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:03.700431 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cqlfm\" (UID: \"710a79ee-17c2-462a-9fe0-a7fc19c18b2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:03.700547 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:44:03.700528 2583 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 29 07:44:03.700594 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:44:03.700585 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates podName:710a79ee-17c2-462a-9fe0-a7fc19c18b2f nodeName:}" failed. No retries permitted until 2026-07-29 07:44:04.200571896 +0000 UTC m=+89.505686701 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" (UID: "710a79ee-17c2-462a-9fe0-a7fc19c18b2f") : secret "prometheus-operator-admission-webhook-tls" not found Jul 29 07:44:04.203331 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:04.203298 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cqlfm\" (UID: \"710a79ee-17c2-462a-9fe0-a7fc19c18b2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:04.205895 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:04.205872 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/710a79ee-17c2-462a-9fe0-a7fc19c18b2f-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cqlfm\" (UID: \"710a79ee-17c2-462a-9fe0-a7fc19c18b2f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:04.404250 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:04.404219 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:04.527337 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:04.527181 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm"] Jul 29 07:44:04.529735 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:04.529709 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod710a79ee_17c2_462a_9fe0_a7fc19c18b2f.slice/crio-1215c05543d81d7b294d8b8423c59a1efbd5398dde28a614f62cb815e8aacc5b WatchSource:0}: Error finding container 1215c05543d81d7b294d8b8423c59a1efbd5398dde28a614f62cb815e8aacc5b: Status 404 returned error can't find the container with id 1215c05543d81d7b294d8b8423c59a1efbd5398dde28a614f62cb815e8aacc5b Jul 29 07:44:04.657112 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:04.657079 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" event={"ID":"710a79ee-17c2-462a-9fe0-a7fc19c18b2f","Type":"ContainerStarted","Data":"1215c05543d81d7b294d8b8423c59a1efbd5398dde28a614f62cb815e8aacc5b"} Jul 29 07:44:05.661665 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:05.661620 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" event={"ID":"710a79ee-17c2-462a-9fe0-a7fc19c18b2f","Type":"ContainerStarted","Data":"8f31f7bf15ae76426d62ee56645b52aa88f1f5731af59da579d379dd961797c3"} Jul 29 07:44:05.662070 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:05.661689 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:05.666177 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:05.666153 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" Jul 29 07:44:05.679039 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:05.678908 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cqlfm" podStartSLOduration=1.746049935 podStartE2EDuration="2.678893541s" totalImagesPullingTime="932.843606ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:05.678561239 +0000 UTC m=+90.983676066" watchObservedRunningTime="2026-07-29 07:44:05.678893541 +0000 UTC m=+90.984008368" Jul 29 07:44:10.929828 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.929792 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9"] Jul 29 07:44:10.934897 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.934867 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:10.937738 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.937712 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 29 07:44:10.937875 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.937720 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 29 07:44:10.938832 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.938806 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 29 07:44:10.938944 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.938847 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-rqhx6\"" Jul 29 07:44:10.938944 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.938904 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 29 07:44:10.939083 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.939050 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 29 07:44:10.948363 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.948333 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9"] Jul 29 07:44:10.963461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.963438 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7glx7"] Jul 29 07:44:10.965826 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.965809 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:10.968856 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.968834 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2tpfc\"" Jul 29 07:44:10.969317 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.969200 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 29 07:44:10.969317 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.969208 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 29 07:44:10.969453 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:10.969418 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 29 07:44:11.054892 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.054861 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.055093 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.054916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.055093 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.055004 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.055093 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.055047 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsk4f\" (UniqueName: \"kubernetes.io/projected/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-kube-api-access-nsk4f\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.156344 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156311 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-textfile\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156361 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44lgs\" (UniqueName: \"kubernetes.io/projected/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-kube-api-access-44lgs\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsk4f\" (UniqueName: \"kubernetes.io/projected/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-kube-api-access-nsk4f\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156452 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-tls\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156479 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-root\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.156525 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156513 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-wtmp\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156556 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156586 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-accelerators-collector-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156624 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-metrics-client-ca\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156653 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156698 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-sys\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.156722 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.159044 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.160062 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.164762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.161051 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.167814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.167763 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsk4f\" (UniqueName: \"kubernetes.io/projected/35a7cd5a-ff0c-49b8-936e-d0954d9dd04c-kube-api-access-nsk4f\") pod \"openshift-state-metrics-b8f49f5c6-ccvq9\" (UID: \"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.245347 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.245317 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259397 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-tls\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259459 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-root\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-wtmp\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259555 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-accelerators-collector-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259599 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-metrics-client-ca\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259636 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259684 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-sys\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259723 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-textfile\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260511 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.259758 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44lgs\" (UniqueName: \"kubernetes.io/projected/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-kube-api-access-44lgs\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260977 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.260933 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-root\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.260977 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.260943 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-sys\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.261104 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.261030 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-wtmp\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.261420 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.261394 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-metrics-client-ca\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.262097 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.262078 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-textfile\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.262356 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.262326 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-accelerators-collector-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.265402 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.265362 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.265518 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.265431 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-node-exporter-tls\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.267620 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.267598 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44lgs\" (UniqueName: \"kubernetes.io/projected/c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08-kube-api-access-44lgs\") pod \"node-exporter-7glx7\" (UID: \"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08\") " pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.277372 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.277344 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7glx7" Jul 29 07:44:11.288790 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:11.288758 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f60e92_5d7b_4a0c_9ce1_9fcae7ff8c08.slice/crio-467b9b8811a29aa5b232d46653c06d5f56eaea7e88b08748952cc311acfccceb WatchSource:0}: Error finding container 467b9b8811a29aa5b232d46653c06d5f56eaea7e88b08748952cc311acfccceb: Status 404 returned error can't find the container with id 467b9b8811a29aa5b232d46653c06d5f56eaea7e88b08748952cc311acfccceb Jul 29 07:44:11.376729 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.376697 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9"] Jul 29 07:44:11.379619 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:11.379595 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35a7cd5a_ff0c_49b8_936e_d0954d9dd04c.slice/crio-1ee31a9c0be43f9f2f5e7ece978ca29ca5f8788c4385b38611e04638ab4f4c68 WatchSource:0}: Error finding container 1ee31a9c0be43f9f2f5e7ece978ca29ca5f8788c4385b38611e04638ab4f4c68: Status 404 returned error can't find the container with id 1ee31a9c0be43f9f2f5e7ece978ca29ca5f8788c4385b38611e04638ab4f4c68 Jul 29 07:44:11.684522 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.684476 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7glx7" event={"ID":"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08","Type":"ContainerStarted","Data":"467b9b8811a29aa5b232d46653c06d5f56eaea7e88b08748952cc311acfccceb"} Jul 29 07:44:11.686208 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.686181 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" event={"ID":"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c","Type":"ContainerStarted","Data":"3137865f8620125bb4dcae6992890146e00a47b49ff9c313b9b369588d9df531"} Jul 29 07:44:11.686312 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.686227 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" event={"ID":"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c","Type":"ContainerStarted","Data":"e02658a867d9da83f51969c2b1f38edd832d9bcc4a063c10cc0bb1986c300fc2"} Jul 29 07:44:11.686312 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:11.686253 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" event={"ID":"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c","Type":"ContainerStarted","Data":"1ee31a9c0be43f9f2f5e7ece978ca29ca5f8788c4385b38611e04638ab4f4c68"} Jul 29 07:44:12.557340 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:12.557306 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-qcj84" Jul 29 07:44:12.692337 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:12.692300 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" event={"ID":"35a7cd5a-ff0c-49b8-936e-d0954d9dd04c","Type":"ContainerStarted","Data":"1898e2f43d81e70fa1fba1821d10c41da9a67b35b7f727144555dd09d22758ed"} Jul 29 07:44:12.693956 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:12.693883 2583 generic.go:356] "Generic (PLEG): container finished" podID="c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08" containerID="92e294a0e5cf3c1f82a338eba660bcae30ab72be4e33fb22d4bbe8d1f25e3a15" exitCode=0 Jul 29 07:44:12.693956 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:12.693936 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7glx7" event={"ID":"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08","Type":"ContainerDied","Data":"92e294a0e5cf3c1f82a338eba660bcae30ab72be4e33fb22d4bbe8d1f25e3a15"} Jul 29 07:44:12.729762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:12.729718 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-ccvq9" podStartSLOduration=1.779652365 podStartE2EDuration="2.729697616s" totalImagesPullingTime="950.045251ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:12.711872569 +0000 UTC m=+98.016987397" watchObservedRunningTime="2026-07-29 07:44:12.729697616 +0000 UTC m=+98.034812444" Jul 29 07:44:13.699197 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:13.699160 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7glx7" event={"ID":"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08","Type":"ContainerStarted","Data":"beb7a3e4b956e866e8e7bf1ef92e523faf9692aa3777e6e2074c7166182cdbf0"} Jul 29 07:44:13.699762 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:13.699218 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7glx7" event={"ID":"c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08","Type":"ContainerStarted","Data":"f887ee546eb8d2b00c6a958914d2b6c7ad26c6526fdf061e79c23186612efcb0"} Jul 29 07:44:13.723438 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:13.723387 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7glx7" podStartSLOduration=2.495625569 podStartE2EDuration="3.7233723s" totalImagesPullingTime="1.154829348s" totalInitContainerRuntime="72.917383ms" isStatefulPod=true podCreationTimestamp="2026-07-29 07:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:13.721341735 +0000 UTC m=+99.026456563" watchObservedRunningTime="2026-07-29 07:44:13.7233723 +0000 UTC m=+99.028487127" Jul 29 07:44:14.031671 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.031641 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68d69f686-8tcxf"] Jul 29 07:44:14.034481 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.034465 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.037268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037243 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 29 07:44:14.037399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037287 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 29 07:44:14.037399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037245 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 29 07:44:14.037399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037248 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nc6xs\"" Jul 29 07:44:14.037399 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037245 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 29 07:44:14.037622 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037294 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eentvdvdcqle0\"" Jul 29 07:44:14.037622 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.037243 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 29 07:44:14.047236 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.047217 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d69f686-8tcxf"] Jul 29 07:44:14.187753 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187717 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187760 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187784 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187799 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfa6495-a4ce-4f00-bd3d-68a72f345acb-metrics-client-ca\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187855 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187882 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.187924 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187915 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5xvw\" (UniqueName: \"kubernetes.io/projected/acfa6495-a4ce-4f00-bd3d-68a72f345acb-kube-api-access-s5xvw\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.188166 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.187947 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-grpc-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289224 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289143 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289224 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289179 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfa6495-a4ce-4f00-bd3d-68a72f345acb-metrics-client-ca\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289224 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289218 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289246 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289285 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5xvw\" (UniqueName: \"kubernetes.io/projected/acfa6495-a4ce-4f00-bd3d-68a72f345acb-kube-api-access-s5xvw\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289328 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-grpc-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289667 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289525 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.289667 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.289585 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.290225 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.290055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/acfa6495-a4ce-4f00-bd3d-68a72f345acb-metrics-client-ca\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.291892 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.291870 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.292180 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.292159 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.292447 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.292425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.292514 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.292473 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.292731 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.292700 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.292954 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.292714 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/acfa6495-a4ce-4f00-bd3d-68a72f345acb-secret-grpc-tls\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.297221 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.297200 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5xvw\" (UniqueName: \"kubernetes.io/projected/acfa6495-a4ce-4f00-bd3d-68a72f345acb-kube-api-access-s5xvw\") pod \"thanos-querier-68d69f686-8tcxf\" (UID: \"acfa6495-a4ce-4f00-bd3d-68a72f345acb\") " pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.344098 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.344069 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:14.497161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.497131 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68d69f686-8tcxf"] Jul 29 07:44:14.500506 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:14.500475 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfa6495_a4ce_4f00_bd3d_68a72f345acb.slice/crio-ed840c52364e4b92dd981829adc4b18795a1f1bf1b1f794a0dd233b363902256 WatchSource:0}: Error finding container ed840c52364e4b92dd981829adc4b18795a1f1bf1b1f794a0dd233b363902256: Status 404 returned error can't find the container with id ed840c52364e4b92dd981829adc4b18795a1f1bf1b1f794a0dd233b363902256 Jul 29 07:44:14.704448 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:14.704363 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"ed840c52364e4b92dd981829adc4b18795a1f1bf1b1f794a0dd233b363902256"} Jul 29 07:44:15.245844 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.245804 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57d674fd86-5pfdn"] Jul 29 07:44:15.250177 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.250153 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.252981 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.252955 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 29 07:44:15.253122 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.252982 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 29 07:44:15.254059 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.254035 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 29 07:44:15.254210 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.254193 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-6uo1pqm4580bc\"" Jul 29 07:44:15.254294 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.254277 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-8cbdj\"" Jul 29 07:44:15.254352 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.254293 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 29 07:44:15.263361 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.263336 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d674fd86-5pfdn"] Jul 29 07:44:15.297638 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297604 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-tls\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297638 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297647 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-client-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297693 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-client-certs\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297710 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-metrics-server-audit-profiles\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297765 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5fcef59-63c1-4b48-862b-2da0a7e2958b-audit-log\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297786 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.297867 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.297814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt67k\" (UniqueName: \"kubernetes.io/projected/c5fcef59-63c1-4b48-862b-2da0a7e2958b-kube-api-access-wt67k\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398326 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398252 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-tls\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398505 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398344 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-client-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398505 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398376 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-client-certs\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398505 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398399 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-metrics-server-audit-profiles\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398660 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398609 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5fcef59-63c1-4b48-862b-2da0a7e2958b-audit-log\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398660 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398640 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.398771 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.398667 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt67k\" (UniqueName: \"kubernetes.io/projected/c5fcef59-63c1-4b48-862b-2da0a7e2958b-kube-api-access-wt67k\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.399566 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.399540 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-metrics-server-audit-profiles\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.399827 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.399804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c5fcef59-63c1-4b48-862b-2da0a7e2958b-audit-log\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.400293 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.400271 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5fcef59-63c1-4b48-862b-2da0a7e2958b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.401556 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.401537 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-tls\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.401636 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.401559 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-client-ca-bundle\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.401967 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.401934 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c5fcef59-63c1-4b48-862b-2da0a7e2958b-secret-metrics-server-client-certs\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.407678 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.407655 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt67k\" (UniqueName: \"kubernetes.io/projected/c5fcef59-63c1-4b48-862b-2da0a7e2958b-kube-api-access-wt67k\") pod \"metrics-server-57d674fd86-5pfdn\" (UID: \"c5fcef59-63c1-4b48-862b-2da0a7e2958b\") " pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.562470 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.562386 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:15.707933 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.707903 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp"] Jul 29 07:44:15.712035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.711158 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.713627 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.713605 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 29 07:44:15.713768 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.713692 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2kr9x\"" Jul 29 07:44:15.724544 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.724516 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp"] Jul 29 07:44:15.741353 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.741318 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d674fd86-5pfdn"] Jul 29 07:44:15.744571 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:15.744536 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fcef59_63c1_4b48_862b_2da0a7e2958b.slice/crio-b1bcc9f20c07a9549b8cb38ff361b59878975370b08889c0041fc6641a6a37fd WatchSource:0}: Error finding container b1bcc9f20c07a9549b8cb38ff361b59878975370b08889c0041fc6641a6a37fd: Status 404 returned error can't find the container with id b1bcc9f20c07a9549b8cb38ff361b59878975370b08889c0041fc6641a6a37fd Jul 29 07:44:15.802334 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.802281 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/325c3c56-db20-48f9-9e33-f19d7ae5984d-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.802510 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.802344 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j6jr\" (UniqueName: \"kubernetes.io/projected/325c3c56-db20-48f9-9e33-f19d7ae5984d-kube-api-access-7j6jr\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.903877 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.903770 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j6jr\" (UniqueName: \"kubernetes.io/projected/325c3c56-db20-48f9-9e33-f19d7ae5984d-kube-api-access-7j6jr\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.904074 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.903893 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/325c3c56-db20-48f9-9e33-f19d7ae5984d-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.906650 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.906625 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/325c3c56-db20-48f9-9e33-f19d7ae5984d-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:15.911630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:15.911607 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j6jr\" (UniqueName: \"kubernetes.io/projected/325c3c56-db20-48f9-9e33-f19d7ae5984d-kube-api-access-7j6jr\") pod \"monitoring-plugin-68b7fc9574-lpmkp\" (UID: \"325c3c56-db20-48f9-9e33-f19d7ae5984d\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:16.022685 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.022648 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:16.166127 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.166043 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-584b5d7897-pzlb2"] Jul 29 07:44:16.168636 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.168612 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.170950 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.170977 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.171111 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.171162 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.171205 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 29 07:44:16.171299 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.171249 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-cnbx4\"" Jul 29 07:44:16.176746 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.176724 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 29 07:44:16.182936 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.182905 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-584b5d7897-pzlb2"] Jul 29 07:44:16.206774 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206742 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-metrics-client-ca\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207017 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206781 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-serving-certs-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207017 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206820 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6znk\" (UniqueName: \"kubernetes.io/projected/4e7be860-4bb8-4e5a-b724-37167fbe2e47-kube-api-access-n6znk\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207017 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206910 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207017 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206953 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-federate-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207017 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.206981 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207225 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.207061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.207225 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.207121 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.308812 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.308439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.308812 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.308494 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-federate-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.308812 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.308521 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.308903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.308967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.309050 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-metrics-client-ca\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.309103 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-serving-certs-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.309147 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6znk\" (UniqueName: \"kubernetes.io/projected/4e7be860-4bb8-4e5a-b724-37167fbe2e47-kube-api-access-n6znk\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.309687 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.309656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-trusted-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.311155 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.310492 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-metrics-client-ca\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.311155 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.311064 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e7be860-4bb8-4e5a-b724-37167fbe2e47-serving-certs-ca-bundle\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.311727 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.311707 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-telemeter-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.311834 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.311789 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-federate-client-tls\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.312137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.312118 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.312349 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.312331 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e7be860-4bb8-4e5a-b724-37167fbe2e47-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.317436 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.317410 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6znk\" (UniqueName: \"kubernetes.io/projected/4e7be860-4bb8-4e5a-b724-37167fbe2e47-kube-api-access-n6znk\") pod \"telemeter-client-584b5d7897-pzlb2\" (UID: \"4e7be860-4bb8-4e5a-b724-37167fbe2e47\") " pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.480496 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.480471 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" Jul 29 07:44:16.481068 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.481046 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp"] Jul 29 07:44:16.651217 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.651190 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-584b5d7897-pzlb2"] Jul 29 07:44:16.653562 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:16.653538 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e7be860_4bb8_4e5a_b724_37167fbe2e47.slice/crio-f9dab720573cf1e90b762f0612cc90034285fbd35897218dad971baf185d15c3 WatchSource:0}: Error finding container f9dab720573cf1e90b762f0612cc90034285fbd35897218dad971baf185d15c3: Status 404 returned error can't find the container with id f9dab720573cf1e90b762f0612cc90034285fbd35897218dad971baf185d15c3 Jul 29 07:44:16.717380 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.717291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"6ecc477dfb52f7a74a89c44705250e92ce43bbb4f3821789f6bc1bca28ddc87c"} Jul 29 07:44:16.717815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.717379 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"d1dbec05bd1aac501c746c868e9d2fd761f30d39116623a8d557575f4e7c2d77"} Jul 29 07:44:16.717815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.717456 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"198fb807f26eb097958f5ae7690ebffe8db6d36af3d1ff83a82af77f3eb7ab86"} Jul 29 07:44:16.719003 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.718956 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" event={"ID":"c5fcef59-63c1-4b48-862b-2da0a7e2958b","Type":"ContainerStarted","Data":"b1bcc9f20c07a9549b8cb38ff361b59878975370b08889c0041fc6641a6a37fd"} Jul 29 07:44:16.720422 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.720388 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" event={"ID":"325c3c56-db20-48f9-9e33-f19d7ae5984d","Type":"ContainerStarted","Data":"f3ea31fbe368d44c87ff7e16fc0c68590bf499778ffc1104c8c92a0a47c058ce"} Jul 29 07:44:16.721743 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:16.721722 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" event={"ID":"4e7be860-4bb8-4e5a-b724-37167fbe2e47","Type":"ContainerStarted","Data":"f9dab720573cf1e90b762f0612cc90034285fbd35897218dad971baf185d15c3"} Jul 29 07:44:17.192014 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.191937 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:44:17.195884 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.195859 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.199393 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199363 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 07:44:17.199704 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199684 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 07:44:17.199801 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199746 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 07:44:17.199801 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199790 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dt5p93j351jnj\"" Jul 29 07:44:17.199906 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199894 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 07:44:17.199955 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.199942 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 07:44:17.200848 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.200829 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.201172 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.201368 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.201587 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7r9lh\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.202641 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.202832 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.203316 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.203484 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 07:44:17.204137 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.203658 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 07:44:17.206222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.206201 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 07:44:17.215207 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.215177 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:44:17.222423 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222565 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222565 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222481 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222565 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222515 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222565 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222546 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222778 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222577 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.222778 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222610 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222900 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.222951 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223020 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223058 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223124 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223088 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223126 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223227 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223257 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223305 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223328 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223391 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.223461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.223433 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6v9jt\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324317 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324281 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324317 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324380 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324405 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324453 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324480 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324512 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324537 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6v9jt\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324614 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324643 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324689 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324737 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324762 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.324818 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.325268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.325268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.324879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.325268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.325106 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.325860 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.325797 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.327138 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.326704 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.327138 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.327010 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.327680 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.327656 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.328396 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.328376 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.329024 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.329004 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.329745 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.329726 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.330325 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.330292 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.330468 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.330445 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.332443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.332747 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.332820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.333041 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.333447 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.333595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.333557 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.334074 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.333734 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.334074 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.333978 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.335325 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.335301 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6v9jt\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.335406 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.335328 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:17.513793 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:17.513763 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:18.141865 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.141820 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:44:18.147366 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:18.147331 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ff87868_3dc6_4a5a_bcc3_2a38059dc091.slice/crio-8f403d313fd56eb71955b7f4c97184fea4650da037756e7c565d3600d0696115 WatchSource:0}: Error finding container 8f403d313fd56eb71955b7f4c97184fea4650da037756e7c565d3600d0696115: Status 404 returned error can't find the container with id 8f403d313fd56eb71955b7f4c97184fea4650da037756e7c565d3600d0696115 Jul 29 07:44:18.736268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.736228 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"778b51f98f094e805efb5832029bee7febb42edbaf64bec86a23a4b0f3b960f7"} Jul 29 07:44:18.736455 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.736314 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"c85d4f41aa3d9c5019d83c1624bf22aac62e6f4754a46f5284c5d2f442fa2009"} Jul 29 07:44:18.736455 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.736354 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" event={"ID":"acfa6495-a4ce-4f00-bd3d-68a72f345acb","Type":"ContainerStarted","Data":"901b832167bcd75e9ef3c66e34962a90861b23d77efcc37667ba57407c4feda0"} Jul 29 07:44:18.736455 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.736402 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:18.738066 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.738040 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" event={"ID":"c5fcef59-63c1-4b48-862b-2da0a7e2958b","Type":"ContainerStarted","Data":"a3865472929044a3dc7fbc66cfaf0a1204cc790904b90a0dd826774518f6fb25"} Jul 29 07:44:18.740261 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.739881 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" event={"ID":"325c3c56-db20-48f9-9e33-f19d7ae5984d","Type":"ContainerStarted","Data":"c9de3d32470ba2e227ffff33129c2fd94359a1821a066a19fb2cf7ca93b8c157"} Jul 29 07:44:18.740261 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.740018 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:18.742434 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.742407 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"8f403d313fd56eb71955b7f4c97184fea4650da037756e7c565d3600d0696115"} Jul 29 07:44:18.748506 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.748482 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" Jul 29 07:44:18.760741 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.760681 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" podStartSLOduration=1.583507219 podStartE2EDuration="4.760666883s" totalImagesPullingTime="3.177159664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:18.758872877 +0000 UTC m=+104.063987731" watchObservedRunningTime="2026-07-29 07:44:18.760666883 +0000 UTC m=+104.065781767" Jul 29 07:44:18.775268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.775217 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-lpmkp" podStartSLOduration=2.302174631 podStartE2EDuration="3.775199561s" totalImagesPullingTime="1.47302493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:18.773852619 +0000 UTC m=+104.078967450" watchObservedRunningTime="2026-07-29 07:44:18.775199561 +0000 UTC m=+104.080314387" Jul 29 07:44:18.792629 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:18.792563 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" podStartSLOduration=1.5799003360000001 podStartE2EDuration="3.792546541s" totalImagesPullingTime="2.212646205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:18.790504373 +0000 UTC m=+104.095619239" watchObservedRunningTime="2026-07-29 07:44:18.792546541 +0000 UTC m=+104.097661369" Jul 29 07:44:19.748955 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.748850 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" exitCode=0 Jul 29 07:44:19.748955 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.748937 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} Jul 29 07:44:19.751400 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.751375 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" event={"ID":"4e7be860-4bb8-4e5a-b724-37167fbe2e47","Type":"ContainerStarted","Data":"2550d278282f9ba0320f7f5da67f12fd9ebe379bd11ffef436cb2d2207a48d7e"} Jul 29 07:44:19.751505 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.751426 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" event={"ID":"4e7be860-4bb8-4e5a-b724-37167fbe2e47","Type":"ContainerStarted","Data":"d5dad950f770ebde10e72a3198bdf92b7f24aa4715ff1713c6dc0e0ce06c1f67"} Jul 29 07:44:19.751505 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.751446 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" event={"ID":"4e7be860-4bb8-4e5a-b724-37167fbe2e47","Type":"ContainerStarted","Data":"788db0d53b995717885bad654f4fe0604f5b3ea26fd46971ba68ce0f80737de6"} Jul 29 07:44:19.810336 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:19.810285 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-584b5d7897-pzlb2" podStartSLOduration=1.022407841 podStartE2EDuration="3.810270306s" totalImagesPullingTime="2.787862465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:19.80910527 +0000 UTC m=+105.114220097" watchObservedRunningTime="2026-07-29 07:44:19.810270306 +0000 UTC m=+105.115385133" Jul 29 07:44:23.776166 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:23.776119 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} Jul 29 07:44:24.757866 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.757835 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68d69f686-8tcxf" Jul 29 07:44:24.785221 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.785183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} Jul 29 07:44:24.785588 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.785250 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} Jul 29 07:44:24.785588 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.785291 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} Jul 29 07:44:24.785588 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.785318 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} Jul 29 07:44:24.785588 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:24.785340 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerStarted","Data":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} Jul 29 07:44:27.514790 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:27.514755 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:44:35.563360 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:35.563324 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:35.563765 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:35.563414 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:44.996208 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:44.996160 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:44:44.998682 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:44.998659 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8c61488-8296-4e7d-a73f-3e756f469c10-metrics-certs\") pod \"network-metrics-daemon-4bd2w\" (UID: \"e8c61488-8296-4e7d-a73f-3e756f469c10\") " pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:44:45.077315 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:45.077283 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b6ztq\"" Jul 29 07:44:45.085444 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:45.085413 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4bd2w" Jul 29 07:44:45.247685 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:45.247582 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=23.090059585 podStartE2EDuration="28.24756279s" totalImagesPullingTime="5.131672794s" totalInitContainerRuntime="25.830411ms" isStatefulPod=false podCreationTimestamp="2026-07-29 07:44:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:24.819515858 +0000 UTC m=+110.124630681" watchObservedRunningTime="2026-07-29 07:44:45.24756279 +0000 UTC m=+130.552677614" Jul 29 07:44:45.248367 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:45.248346 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4bd2w"] Jul 29 07:44:45.251016 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:44:45.250973 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c61488_8296_4e7d_a73f_3e756f469c10.slice/crio-344f1b560c8a1af191a0bfca1dbcd557c34c12e60ba1370104755536ef45b2ca WatchSource:0}: Error finding container 344f1b560c8a1af191a0bfca1dbcd557c34c12e60ba1370104755536ef45b2ca: Status 404 returned error can't find the container with id 344f1b560c8a1af191a0bfca1dbcd557c34c12e60ba1370104755536ef45b2ca Jul 29 07:44:45.877077 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:45.877029 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bd2w" event={"ID":"e8c61488-8296-4e7d-a73f-3e756f469c10","Type":"ContainerStarted","Data":"344f1b560c8a1af191a0bfca1dbcd557c34c12e60ba1370104755536ef45b2ca"} Jul 29 07:44:46.883286 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.883249 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bd2w" event={"ID":"e8c61488-8296-4e7d-a73f-3e756f469c10","Type":"ContainerStarted","Data":"d2699dc4770de0871c3b5e5b8b41f4adb4fd196f7039855feec9688688181731"} Jul 29 07:44:46.883767 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.883312 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4bd2w" event={"ID":"e8c61488-8296-4e7d-a73f-3e756f469c10","Type":"ContainerStarted","Data":"682bda4b5f913c5bedb5f9326d479eeeded275f7548e0130965ce84e4aa440ba"} Jul 29 07:44:46.884688 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.884661 2583 generic.go:356] "Generic (PLEG): container finished" podID="e7571a46-e8cd-450b-88ad-befabaa61213" containerID="2168e9084f6f79ce7f0e45250b563b91704caa310c391e36c56879be238210e4" exitCode=0 Jul 29 07:44:46.884791 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.884736 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" event={"ID":"e7571a46-e8cd-450b-88ad-befabaa61213","Type":"ContainerDied","Data":"2168e9084f6f79ce7f0e45250b563b91704caa310c391e36c56879be238210e4"} Jul 29 07:44:46.885059 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.885045 2583 scope.go:117] "RemoveContainer" containerID="2168e9084f6f79ce7f0e45250b563b91704caa310c391e36c56879be238210e4" Jul 29 07:44:46.899960 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:46.899893 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4bd2w" podStartSLOduration=130.995327066 podStartE2EDuration="2m11.899868291s" totalImagesPullingTime="904.541225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:42:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:44:46.897352239 +0000 UTC m=+132.202467067" watchObservedRunningTime="2026-07-29 07:44:46.899868291 +0000 UTC m=+132.204983118" Jul 29 07:44:47.892804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:47.892758 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-x8tsg" event={"ID":"e7571a46-e8cd-450b-88ad-befabaa61213","Type":"ContainerStarted","Data":"0af0582187c1114be52d2acaea3886823738e8a1b4a07410bcfa8a1da1a37240"} Jul 29 07:44:55.568382 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:55.568351 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:44:55.572747 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:44:55.572725 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57d674fd86-5pfdn" Jul 29 07:45:01.948389 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:01.948358 2583 generic.go:356] "Generic (PLEG): container finished" podID="620072be-215b-429c-9a33-a493eef4007f" containerID="b45ed189246f8736fea1598888ca759dbc38bde7a5e85eccb68ae02aea603ddb" exitCode=0 Jul 29 07:45:01.948804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:01.948443 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" event={"ID":"620072be-215b-429c-9a33-a493eef4007f","Type":"ContainerDied","Data":"b45ed189246f8736fea1598888ca759dbc38bde7a5e85eccb68ae02aea603ddb"} Jul 29 07:45:01.948804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:01.948761 2583 scope.go:117] "RemoveContainer" containerID="b45ed189246f8736fea1598888ca759dbc38bde7a5e85eccb68ae02aea603ddb" Jul 29 07:45:02.954760 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:02.954719 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx" event={"ID":"620072be-215b-429c-9a33-a493eef4007f","Type":"ContainerStarted","Data":"fbc10a1b200debee75eac632aeb5139eb4570b47df6938d7583f98a3873b0eb6"} Jul 29 07:45:17.515160 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:17.515123 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:17.531542 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:17.531513 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:18.034238 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:18.034204 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:35.540021 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.539924 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540249 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="prometheus" containerID="cri-o://0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" gracePeriod=600 Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540298 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-thanos" containerID="cri-o://3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" gracePeriod=600 Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540289 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="config-reloader" containerID="cri-o://d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" gracePeriod=600 Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540300 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="thanos-sidecar" containerID="cri-o://4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" gracePeriod=600 Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540322 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-web" containerID="cri-o://3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" gracePeriod=600 Jul 29 07:45:35.540529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.540266 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy" containerID="cri-o://d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" gracePeriod=600 Jul 29 07:45:35.785805 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.785779 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:35.943726 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943632 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.943726 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943674 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6v9jt\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.943726 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943710 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943743 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943800 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943831 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943866 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943903 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943929 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943952 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.943975 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944048 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944037 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944068 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944097 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944122 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944149 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944195 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944225 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944252 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944281 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out\") pod \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\" (UID: \"4ff87868-3dc6-4a5a-bcc3-2a38059dc091\") " Jul 29 07:45:35.944476 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944272 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.944901 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.944570 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.945333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.945303 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.946102 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.945963 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 07:45:35.946341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946237 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.946700 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946669 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt" (OuterVolumeSpecName: "kube-api-access-6v9jt") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "kube-api-access-6v9jt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 07:45:35.946788 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946721 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.946937 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946914 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6v9jt\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-kube-api-access-6v9jt\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946944 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946950 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 07:45:35.947035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.946962 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947035 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947025 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config" (OuterVolumeSpecName: "config") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947024 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-metrics-client-certs\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947068 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-metrics-client-ca\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947084 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-db\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947098 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947401 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947409 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.947562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947419 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.947927 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947677 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.947927 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.947849 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 29 07:45:35.948847 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.948821 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.948939 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.948878 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out" (OuterVolumeSpecName: "config-out") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 07:45:35.949146 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.949125 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.949673 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.949656 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.949857 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.949838 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:35.960743 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:35.960722 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config" (OuterVolumeSpecName: "web-config") pod "4ff87868-3dc6-4a5a-bcc3-2a38059dc091" (UID: "4ff87868-3dc6-4a5a-bcc3-2a38059dc091"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 29 07:45:36.048354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048314 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048343 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config-out\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048353 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-tls-assets\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048362 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-kube-rbac-proxy\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048371 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048380 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-grpc-tls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048388 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048396 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048405 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048413 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-web-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048422 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-config\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048430 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.048600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.048438 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ff87868-3dc6-4a5a-bcc3-2a38059dc091-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:45:36.097630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097598 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" exitCode=0 Jul 29 07:45:36.097630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097624 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" exitCode=0 Jul 29 07:45:36.097630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097630 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" exitCode=0 Jul 29 07:45:36.097630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097636 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" exitCode=0 Jul 29 07:45:36.097630 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097641 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" exitCode=0 Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097646 2583 generic.go:356] "Generic (PLEG): container finished" podID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" exitCode=0 Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097695 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097690 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097839 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097865 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097890 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097915 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097925 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097939 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} Jul 29 07:45:36.098037 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.097965 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ff87868-3dc6-4a5a-bcc3-2a38059dc091","Type":"ContainerDied","Data":"8f403d313fd56eb71955b7f4c97184fea4650da037756e7c565d3600d0696115"} Jul 29 07:45:36.106794 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.106771 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.114131 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.114111 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.121342 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.121319 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:36.121787 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.121772 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.124562 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.124541 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:36.128885 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.128869 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.136144 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.136123 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.143695 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.143678 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.148894 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.148869 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:36.149370 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149353 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-thanos" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149373 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-thanos" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149384 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="init-config-reloader" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149390 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="init-config-reloader" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149400 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="thanos-sidecar" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149407 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="thanos-sidecar" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149415 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="config-reloader" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149421 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="config-reloader" Jul 29 07:45:36.149429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149432 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="prometheus" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149437 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="prometheus" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149443 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-web" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149448 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-web" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149455 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149460 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149529 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="config-reloader" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149536 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="thanos-sidecar" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149544 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-web" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149549 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149554 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="kube-rbac-proxy-thanos" Jul 29 07:45:36.149655 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.149561 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" containerName="prometheus" Jul 29 07:45:36.151437 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.151420 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.151721 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.151701 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.151776 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.151730 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.151776 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.151763 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.152025 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.152005 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.152089 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152032 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.152089 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152048 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.152292 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.152271 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.152333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152301 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.152333 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152316 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.152538 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.152523 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.152574 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152544 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.152574 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152558 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.152776 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.152759 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.152819 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152782 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.152819 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.152795 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.153079 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.153058 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.153128 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153086 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.153128 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153105 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.153345 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:45:36.153328 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.153386 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153350 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.153386 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153364 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.153444 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153390 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.153814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153572 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.153814 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153594 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.153977 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153950 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.154065 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.153981 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.154288 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154269 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.154337 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154290 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.154558 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154537 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.154558 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154558 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.154804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154786 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.154804 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.154805 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.155043 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155026 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.155102 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155044 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.155277 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155258 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.155345 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155279 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.155543 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155526 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.155593 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155545 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.155769 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155747 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.155769 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155767 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.156001 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155967 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.156001 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.155982 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156266 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156289 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156371 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156491 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156492 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156512 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156522 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dt5p93j351jnj\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156593 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156624 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156640 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 29 07:45:36.156664 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156641 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156763 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156816 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156840 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.156864 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157057 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-7r9lh\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157091 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157105 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157109 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157295 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.157374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157317 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.157845 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157562 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.157845 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157586 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.157947 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157901 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.157947 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.157924 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.158241 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158218 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.158351 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158243 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.158622 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158591 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.158695 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158625 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.158975 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158952 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.159095 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.158976 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.159293 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159271 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.159293 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159296 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.159544 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159513 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.159634 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159552 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.159697 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159645 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 29 07:45:36.159825 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159800 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.159918 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.159827 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.160209 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160175 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.160209 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160202 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.160493 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160475 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.160564 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160494 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.160697 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160676 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.160768 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160699 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.160956 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160937 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.161041 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.160956 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.161356 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161232 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.161356 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161256 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.161677 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161499 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 29 07:45:36.161677 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161624 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.161677 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161663 2583 scope.go:117] "RemoveContainer" containerID="3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf" Jul 29 07:45:36.161905 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161882 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf"} err="failed to get container status \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": rpc error: code = NotFound desc = could not find container \"3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf\": container with ID starting with 3ac4607a95e9da3760376fb6b387fed4683f8243c4ad40a13b36cbc4cd11e7cf not found: ID does not exist" Jul 29 07:45:36.162018 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.161907 2583 scope.go:117] "RemoveContainer" containerID="d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f" Jul 29 07:45:36.162205 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162189 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f"} err="failed to get container status \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": rpc error: code = NotFound desc = could not find container \"d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f\": container with ID starting with d45cb94c7ebaf312d6980cc6d0d8fa3ba168b54fab20ac5508fa201d790aec5f not found: ID does not exist" Jul 29 07:45:36.162254 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162207 2583 scope.go:117] "RemoveContainer" containerID="3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831" Jul 29 07:45:36.162441 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162421 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831"} err="failed to get container status \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": rpc error: code = NotFound desc = could not find container \"3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831\": container with ID starting with 3e4ccbfa397854c1c1f1ec832d6668398a915b557cc5fe9cdc8fee6ef0cc7831 not found: ID does not exist" Jul 29 07:45:36.162521 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162442 2583 scope.go:117] "RemoveContainer" containerID="4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d" Jul 29 07:45:36.162653 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162637 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d"} err="failed to get container status \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": rpc error: code = NotFound desc = could not find container \"4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d\": container with ID starting with 4ec708d7faeb48be4464168327f01ee14763d89d4831d8f7faa855f74bcd281d not found: ID does not exist" Jul 29 07:45:36.162703 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162654 2583 scope.go:117] "RemoveContainer" containerID="d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf" Jul 29 07:45:36.162861 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162843 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf"} err="failed to get container status \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": rpc error: code = NotFound desc = could not find container \"d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf\": container with ID starting with d5cf47fc437c014964fde9adc3427af27d530d4e233b09a72a7e18f178b560cf not found: ID does not exist" Jul 29 07:45:36.162930 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.162863 2583 scope.go:117] "RemoveContainer" containerID="0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea" Jul 29 07:45:36.163094 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.163078 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea"} err="failed to get container status \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": rpc error: code = NotFound desc = could not find container \"0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea\": container with ID starting with 0d70650823fb7929b9c589e096c910bfe284e2d0803d7429c06558a1ff320eea not found: ID does not exist" Jul 29 07:45:36.163159 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.163094 2583 scope.go:117] "RemoveContainer" containerID="82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00" Jul 29 07:45:36.163297 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.163276 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00"} err="failed to get container status \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": rpc error: code = NotFound desc = could not find container \"82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00\": container with ID starting with 82f70ae6738991992c00707177d1d64597b6eb16e3128d46340b7fe43c8beb00 not found: ID does not exist" Jul 29 07:45:36.167622 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.167599 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:36.249974 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.249945 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.249980 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250108 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250144 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250236 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250274 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250315 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250341 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250337 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250356 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250384 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pddbr\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-kube-api-access-pddbr\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250427 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250446 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250464 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250482 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.250681 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.250540 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351339 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351374 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351375 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351605 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351403 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351605 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351605 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351455 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351605 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351488 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.351605 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351510 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351886 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351929 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.351956 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352030 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352060 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pddbr\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-kube-api-access-pddbr\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352100 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352105 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352326 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.352394 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352327 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352517 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352573 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352641 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352712 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.353222 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.352780 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.354692 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.354511 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-web-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.355613 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.355318 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.355613 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.355429 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-config\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.355770 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.355665 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.355770 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.354608 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.356370 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.356342 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.356551 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.356531 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8938badc-8f73-4d56-877b-451b1e268b7f-config-out\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.356619 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.356535 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.357393 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.357363 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.357486 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.357420 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.357486 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.357460 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8938badc-8f73-4d56-877b-451b1e268b7f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.357900 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.357875 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.359141 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.359087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.359141 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.359103 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.359294 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.359171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.360474 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.360441 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pddbr\" (UniqueName: \"kubernetes.io/projected/8938badc-8f73-4d56-877b-451b1e268b7f-kube-api-access-pddbr\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.362870 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.362571 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8938badc-8f73-4d56-877b-451b1e268b7f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8938badc-8f73-4d56-877b-451b1e268b7f\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.464531 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.464491 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:45:36.627951 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:36.627914 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 29 07:45:36.630941 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:45:36.630911 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8938badc_8f73_4d56_877b_451b1e268b7f.slice/crio-21f102929ab318f8d76b5647fc635679329acefb0dad613847a8f2b81d0d79bb WatchSource:0}: Error finding container 21f102929ab318f8d76b5647fc635679329acefb0dad613847a8f2b81d0d79bb: Status 404 returned error can't find the container with id 21f102929ab318f8d76b5647fc635679329acefb0dad613847a8f2b81d0d79bb Jul 29 07:45:37.103589 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:37.103547 2583 generic.go:356] "Generic (PLEG): container finished" podID="8938badc-8f73-4d56-877b-451b1e268b7f" containerID="70d5efb4cbccd419be9dfb6153df3c03f20a78da07d780c54b0b393f072dd722" exitCode=0 Jul 29 07:45:37.103789 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:37.103640 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerDied","Data":"70d5efb4cbccd419be9dfb6153df3c03f20a78da07d780c54b0b393f072dd722"} Jul 29 07:45:37.103789 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:37.103728 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"21f102929ab318f8d76b5647fc635679329acefb0dad613847a8f2b81d0d79bb"} Jul 29 07:45:37.259324 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:37.259292 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ff87868-3dc6-4a5a-bcc3-2a38059dc091" path="/var/lib/kubelet/pods/4ff87868-3dc6-4a5a-bcc3-2a38059dc091/volumes" Jul 29 07:45:38.112662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112616 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"942f3fe1c11ed2319e18f3aeb6e6bb22512fe3b8002842a51da5a6de1c8f85ca"} Jul 29 07:45:38.113161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112682 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"ca06dec256d4f0b908e1d7560711e61c32ff0c114ef51d18ca2b1a550ae7eae4"} Jul 29 07:45:38.113161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112715 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"0df93dd295914124bbbca5e39f5b79712493d08d8a1b5234386ad1cea6f15932"} Jul 29 07:45:38.113161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112740 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"f906b220cd730681df5aa3a160949cf614938ac71273fc2a8efe67780b5e6844"} Jul 29 07:45:38.113161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112763 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"bbea7e6c6f317fdf436102d37b15d9a3bfd0842008c69103bf43c1e326a9cbb9"} Jul 29 07:45:38.113161 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.112786 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8938badc-8f73-4d56-877b-451b1e268b7f","Type":"ContainerStarted","Data":"0a301daf9687e63921b52fa4b4e16aedec0b3738b4cae9272745955642bf9fb2"} Jul 29 07:45:38.145272 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:38.145217 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.125362187 podStartE2EDuration="2.145200138s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.837951ms" isStatefulPod=false podCreationTimestamp="2026-07-29 07:45:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:45:38.143100385 +0000 UTC m=+183.448215212" watchObservedRunningTime="2026-07-29 07:45:38.145200138 +0000 UTC m=+183.450314964" Jul 29 07:45:41.464832 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:45:41.464800 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:46:36.464949 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:46:36.464910 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:46:36.481513 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:46:36.481483 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:46:37.365675 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:46:37.365649 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 29 07:47:35.084770 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:47:35.084741 2583 kubelet.go:1648] "Image garbage collection succeeded" Jul 29 07:49:24.047764 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.047728 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-k4wkd"] Jul 29 07:49:24.051160 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.051144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:49:24.054246 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.054224 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 29 07:49:24.055330 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.055315 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 29 07:49:24.055421 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.055320 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-gqtb7\"" Jul 29 07:49:24.064107 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.064083 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-k4wkd"] Jul 29 07:49:24.223284 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.223249 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v98kz\" (UniqueName: \"kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz\") pod \"test-trainjob-workflow-node-0-0-k4wkd\" (UID: \"4112a530-b236-43bc-a319-c7a1f4ec9afd\") " pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:49:24.324468 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.324377 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98kz\" (UniqueName: \"kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz\") pod \"test-trainjob-workflow-node-0-0-k4wkd\" (UID: \"4112a530-b236-43bc-a319-c7a1f4ec9afd\") " pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:49:24.332385 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.332360 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v98kz\" (UniqueName: \"kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz\") pod \"test-trainjob-workflow-node-0-0-k4wkd\" (UID: \"4112a530-b236-43bc-a319-c7a1f4ec9afd\") " pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:49:24.371604 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.371572 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:49:24.501688 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.501664 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-k4wkd"] Jul 29 07:49:24.504123 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:49:24.504096 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4112a530_b236_43bc_a319_c7a1f4ec9afd.slice/crio-e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5 WatchSource:0}: Error finding container e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5: Status 404 returned error can't find the container with id e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5 Jul 29 07:49:24.505976 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:24.505957 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 29 07:49:25.030485 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:49:25.030455 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" event={"ID":"4112a530-b236-43bc-a319-c7a1f4ec9afd","Type":"ContainerStarted","Data":"e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5"} Jul 29 07:50:28.362889 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:28.362851 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" event={"ID":"4112a530-b236-43bc-a319-c7a1f4ec9afd","Type":"ContainerStarted","Data":"c3a72a0ff961c3a6daa1b72939e9b03bcf2ce44d7ee8518f239bc7dade834430"} Jul 29 07:50:28.380781 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:28.380718 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" podStartSLOduration=1.583670143 podStartE2EDuration="1m4.380699407s" totalImagesPullingTime="1m2.797029264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:49:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:50:28.378606159 +0000 UTC m=+473.683721011" watchObservedRunningTime="2026-07-29 07:50:28.380699407 +0000 UTC m=+473.685814238" Jul 29 07:50:30.374422 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:30.374386 2583 generic.go:356] "Generic (PLEG): container finished" podID="4112a530-b236-43bc-a319-c7a1f4ec9afd" containerID="c3a72a0ff961c3a6daa1b72939e9b03bcf2ce44d7ee8518f239bc7dade834430" exitCode=0 Jul 29 07:50:30.374821 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:30.374463 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" event={"ID":"4112a530-b236-43bc-a319-c7a1f4ec9afd","Type":"ContainerDied","Data":"c3a72a0ff961c3a6daa1b72939e9b03bcf2ce44d7ee8518f239bc7dade834430"} Jul 29 07:50:31.530074 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:31.530043 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:50:31.539932 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:31.539913 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v98kz\" (UniqueName: \"kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz\") pod \"4112a530-b236-43bc-a319-c7a1f4ec9afd\" (UID: \"4112a530-b236-43bc-a319-c7a1f4ec9afd\") " Jul 29 07:50:31.542253 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:31.542231 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz" (OuterVolumeSpecName: "kube-api-access-v98kz") pod "4112a530-b236-43bc-a319-c7a1f4ec9afd" (UID: "4112a530-b236-43bc-a319-c7a1f4ec9afd"). InnerVolumeSpecName "kube-api-access-v98kz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 07:50:31.641455 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:31.641374 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v98kz\" (UniqueName: \"kubernetes.io/projected/4112a530-b236-43bc-a319-c7a1f4ec9afd-kube-api-access-v98kz\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:50:32.384815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:32.384784 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" event={"ID":"4112a530-b236-43bc-a319-c7a1f4ec9afd","Type":"ContainerDied","Data":"e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5"} Jul 29 07:50:32.384815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:32.384811 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-k4wkd" Jul 29 07:50:32.384815 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:32.384823 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e944db3ede94f468ab1a7eac3786d982e0cb48206bc1a34a12d81920b364f3d5" Jul 29 07:50:33.294126 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:33.294016 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-k4wkd"] Jul 29 07:50:33.295383 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:33.295361 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-k4wkd"] Jul 29 07:50:34.647097 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.647063 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sccvl/must-gather-5svsh"] Jul 29 07:50:34.647611 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.647584 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4112a530-b236-43bc-a319-c7a1f4ec9afd" containerName="node" Jul 29 07:50:34.647611 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.647604 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4112a530-b236-43bc-a319-c7a1f4ec9afd" containerName="node" Jul 29 07:50:34.647738 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.647690 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4112a530-b236-43bc-a319-c7a1f4ec9afd" containerName="node" Jul 29 07:50:34.710707 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.710665 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sccvl/must-gather-5svsh"] Jul 29 07:50:34.710885 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.710782 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.713358 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.713336 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sccvl\"/\"kube-root-ca.crt\"" Jul 29 07:50:34.714327 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.714307 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sccvl\"/\"openshift-service-ca.crt\"" Jul 29 07:50:34.714429 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.714348 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sccvl\"/\"default-dockercfg-nvqrc\"" Jul 29 07:50:34.767508 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.767478 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjxt8\" (UniqueName: \"kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.767672 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.767518 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.868651 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.868622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjxt8\" (UniqueName: \"kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.868869 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.868666 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.868972 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.868956 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:34.876315 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:34.876291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjxt8\" (UniqueName: \"kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8\") pod \"must-gather-5svsh\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:35.030792 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:35.030760 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:50:35.185610 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:35.185537 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sccvl/must-gather-5svsh"] Jul 29 07:50:35.187881 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:50:35.187851 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10f0d677_59d6_4405_a6c3_57311da0caa9.slice/crio-aabd927601d063ee551b1089da5e332ee88015258f067dfc11ee3b71ca0fffa7 WatchSource:0}: Error finding container aabd927601d063ee551b1089da5e332ee88015258f067dfc11ee3b71ca0fffa7: Status 404 returned error can't find the container with id aabd927601d063ee551b1089da5e332ee88015258f067dfc11ee3b71ca0fffa7 Jul 29 07:50:35.261051 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:35.261019 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4112a530-b236-43bc-a319-c7a1f4ec9afd" path="/var/lib/kubelet/pods/4112a530-b236-43bc-a319-c7a1f4ec9afd/volumes" Jul 29 07:50:35.398268 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:35.398195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sccvl/must-gather-5svsh" event={"ID":"10f0d677-59d6-4405-a6c3-57311da0caa9","Type":"ContainerStarted","Data":"aabd927601d063ee551b1089da5e332ee88015258f067dfc11ee3b71ca0fffa7"} Jul 29 07:50:44.441474 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:44.441433 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sccvl/must-gather-5svsh" event={"ID":"10f0d677-59d6-4405-a6c3-57311da0caa9","Type":"ContainerStarted","Data":"8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4"} Jul 29 07:50:44.441903 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:44.441497 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sccvl/must-gather-5svsh" event={"ID":"10f0d677-59d6-4405-a6c3-57311da0caa9","Type":"ContainerStarted","Data":"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170"} Jul 29 07:50:44.457154 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:50:44.457086 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sccvl/must-gather-5svsh" podStartSLOduration=2.3501571820000002 podStartE2EDuration="10.457071964s" totalImagesPullingTime="8.106914782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 07:50:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:50:44.456641512 +0000 UTC m=+489.761756371" watchObservedRunningTime="2026-07-29 07:50:44.457071964 +0000 UTC m=+489.762186791" Jul 29 07:51:29.654120 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:29.654082 2583 generic.go:356] "Generic (PLEG): container finished" podID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerID="9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170" exitCode=0 Jul 29 07:51:29.654529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:29.654157 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sccvl/must-gather-5svsh" event={"ID":"10f0d677-59d6-4405-a6c3-57311da0caa9","Type":"ContainerDied","Data":"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170"} Jul 29 07:51:29.654529 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:29.654491 2583 scope.go:117] "RemoveContainer" containerID="9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170" Jul 29 07:51:30.006729 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:30.006699 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sccvl_must-gather-5svsh_10f0d677-59d6-4405-a6c3-57311da0caa9/gather/0.log" Jul 29 07:51:33.231292 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:33.231241 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nkld9_af95dd1e-6288-4012-992d-f8f9d2999fd4/global-pull-secret-syncer/0.log" Jul 29 07:51:33.410781 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:33.410746 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zlx8t_83bb885b-b355-449f-a1e4-6eb8248b4f20/konnectivity-agent/0.log" Jul 29 07:51:33.477743 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:33.477709 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-121.ec2.internal_5335f321bbdc98b925d1a74da4b1481d/haproxy/0.log" Jul 29 07:51:35.354978 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.354944 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-sccvl/must-gather-5svsh"] Jul 29 07:51:35.355419 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.355152 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-sccvl/must-gather-5svsh" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="copy" containerID="cri-o://8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4" gracePeriod=2 Jul 29 07:51:35.360960 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.360935 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-sccvl/must-gather-5svsh"] Jul 29 07:51:35.362100 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.362062 2583 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"10f0d677-59d6-4405-a6c3-57311da0caa9\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-sccvl\"/\"must-gather-5svsh\": pods \"must-gather-5svsh\" not found" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:35.593175 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.593152 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sccvl_must-gather-5svsh_10f0d677-59d6-4405-a6c3-57311da0caa9/copy/0.log" Jul 29 07:51:35.594759 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.594742 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:35.596854 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.596831 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5svsh\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sccvl\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:35.681461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.681386 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-sccvl_must-gather-5svsh_10f0d677-59d6-4405-a6c3-57311da0caa9/copy/0.log" Jul 29 07:51:35.681734 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.681713 2583 generic.go:356] "Generic (PLEG): container finished" podID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerID="8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4" exitCode=143 Jul 29 07:51:35.681839 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.681824 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:35.681878 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.681866 2583 scope.go:117] "RemoveContainer" containerID="8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4" Jul 29 07:51:35.684207 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.684159 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5svsh\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sccvl\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:35.689841 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.689824 2583 scope.go:117] "RemoveContainer" containerID="9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170" Jul 29 07:51:35.702595 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.702568 2583 scope.go:117] "RemoveContainer" containerID="8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4" Jul 29 07:51:35.702879 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.702858 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4\": container with ID starting with 8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4 not found: ID does not exist" containerID="8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4" Jul 29 07:51:35.702966 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.702892 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4"} err="failed to get container status \"8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4\": rpc error: code = NotFound desc = could not find container \"8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4\": container with ID starting with 8110e632672363d7eb31f76fe9abcb62fc8660f16a2f99b2e9ae27e8de7f5bf4 not found: ID does not exist" Jul 29 07:51:35.702966 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.702918 2583 scope.go:117] "RemoveContainer" containerID="9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170" Jul 29 07:51:35.703301 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.703279 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170\": container with ID starting with 9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170 not found: ID does not exist" containerID="9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170" Jul 29 07:51:35.703350 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.703307 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170"} err="failed to get container status \"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170\": rpc error: code = NotFound desc = could not find container \"9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170\": container with ID starting with 9959f65621121ea401653b3413e9d1beffd2911fc4e3ff4f5c5aa4748c765170 not found: ID does not exist" Jul 29 07:51:35.724704 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.724669 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjxt8\" (UniqueName: \"kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8\") pod \"10f0d677-59d6-4405-a6c3-57311da0caa9\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " Jul 29 07:51:35.724849 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.724715 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output\") pod \"10f0d677-59d6-4405-a6c3-57311da0caa9\" (UID: \"10f0d677-59d6-4405-a6c3-57311da0caa9\") " Jul 29 07:51:35.725978 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.725955 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "10f0d677-59d6-4405-a6c3-57311da0caa9" (UID: "10f0d677-59d6-4405-a6c3-57311da0caa9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 29 07:51:35.727011 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.726975 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8" (OuterVolumeSpecName: "kube-api-access-zjxt8") pod "10f0d677-59d6-4405-a6c3-57311da0caa9" (UID: "10f0d677-59d6-4405-a6c3-57311da0caa9"). InnerVolumeSpecName "kube-api-access-zjxt8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 29 07:51:35.825614 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.825567 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjxt8\" (UniqueName: \"kubernetes.io/projected/10f0d677-59d6-4405-a6c3-57311da0caa9-kube-api-access-zjxt8\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:51:35.825614 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:35.825602 2583 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/10f0d677-59d6-4405-a6c3-57311da0caa9-must-gather-output\") on node \"ip-10-0-137-121.ec2.internal\" DevicePath \"\"" Jul 29 07:51:35.992265 ip-10-0-137-121 kubenswrapper[2583]: E0729 07:51:35.992231 2583 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-5svsh\" is forbidden: User \"system:node:ip-10-0-137-121.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-sccvl\": no relationship found between node 'ip-10-0-137-121.ec2.internal' and this object" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" pod="openshift-must-gather-sccvl/must-gather-5svsh" Jul 29 07:51:37.257884 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:37.257851 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" path="/var/lib/kubelet/pods/10f0d677-59d6-4405-a6c3-57311da0caa9/volumes" Jul 29 07:51:37.883805 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:37.883717 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57d674fd86-5pfdn_c5fcef59-63c1-4b48-862b-2da0a7e2958b/metrics-server/0.log" Jul 29 07:51:37.911043 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:37.911010 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-lpmkp_325c3c56-db20-48f9-9e33-f19d7ae5984d/monitoring-plugin/0.log" Jul 29 07:51:38.008475 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.008444 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7glx7_c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08/node-exporter/0.log" Jul 29 07:51:38.029596 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.029563 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7glx7_c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08/kube-rbac-proxy/0.log" Jul 29 07:51:38.049768 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.049751 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7glx7_c2f60e92-5d7b-4a0c-9ce1-9fcae7ff8c08/init-textfile/0.log" Jul 29 07:51:38.146652 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.146571 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ccvq9_35a7cd5a-ff0c-49b8-936e-d0954d9dd04c/kube-rbac-proxy-main/0.log" Jul 29 07:51:38.169899 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.169873 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ccvq9_35a7cd5a-ff0c-49b8-936e-d0954d9dd04c/kube-rbac-proxy-self/0.log" Jul 29 07:51:38.190415 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.190394 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-ccvq9_35a7cd5a-ff0c-49b8-936e-d0954d9dd04c/openshift-state-metrics/0.log" Jul 29 07:51:38.222826 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.222799 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/prometheus/0.log" Jul 29 07:51:38.244681 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.244660 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/config-reloader/0.log" Jul 29 07:51:38.269930 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.269911 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/thanos-sidecar/0.log" Jul 29 07:51:38.293229 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.293205 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/kube-rbac-proxy-web/0.log" Jul 29 07:51:38.314976 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.314958 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/kube-rbac-proxy/0.log" Jul 29 07:51:38.337571 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.337554 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/kube-rbac-proxy-thanos/0.log" Jul 29 07:51:38.357662 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.357635 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8938badc-8f73-4d56-877b-451b1e268b7f/init-config-reloader/0.log" Jul 29 07:51:38.438218 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.438131 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-cqlfm_710a79ee-17c2-462a-9fe0-a7fc19c18b2f/prometheus-operator-admission-webhook/0.log" Jul 29 07:51:38.474959 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.474931 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584b5d7897-pzlb2_4e7be860-4bb8-4e5a-b724-37167fbe2e47/telemeter-client/0.log" Jul 29 07:51:38.501484 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.501463 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584b5d7897-pzlb2_4e7be860-4bb8-4e5a-b724-37167fbe2e47/reload/0.log" Jul 29 07:51:38.529957 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.529938 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-584b5d7897-pzlb2_4e7be860-4bb8-4e5a-b724-37167fbe2e47/kube-rbac-proxy/0.log" Jul 29 07:51:38.585439 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.585407 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/thanos-query/0.log" Jul 29 07:51:38.611373 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.611351 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/kube-rbac-proxy-web/0.log" Jul 29 07:51:38.635456 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.635424 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/kube-rbac-proxy/0.log" Jul 29 07:51:38.662701 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.662679 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/prom-label-proxy/0.log" Jul 29 07:51:38.694659 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.694596 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/kube-rbac-proxy-rules/0.log" Jul 29 07:51:38.716553 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:38.716532 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68d69f686-8tcxf_acfa6495-a4ce-4f00-bd3d-68a72f345acb/kube-rbac-proxy-metrics/0.log" Jul 29 07:51:40.976641 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.976600 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w"] Jul 29 07:51:40.977121 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977099 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="copy" Jul 29 07:51:40.977213 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977123 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="copy" Jul 29 07:51:40.977213 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977146 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="gather" Jul 29 07:51:40.977213 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977154 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="gather" Jul 29 07:51:40.977354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977248 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="copy" Jul 29 07:51:40.977354 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.977260 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f0d677-59d6-4405-a6c3-57311da0caa9" containerName="gather" Jul 29 07:51:40.980920 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.980898 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:40.983171 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.983141 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5kjlb\"/\"default-dockercfg-z4g78\"" Jul 29 07:51:40.983255 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.983173 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5kjlb\"/\"kube-root-ca.crt\"" Jul 29 07:51:40.984200 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.984183 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5kjlb\"/\"openshift-service-ca.crt\"" Jul 29 07:51:40.990047 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:40.990022 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w"] Jul 29 07:51:41.070050 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.070014 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-lib-modules\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.070220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.070074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-proc\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.070220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.070116 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-podres\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.070220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.070167 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btp2w\" (UniqueName: \"kubernetes.io/projected/dc21a37b-49a7-46aa-9201-d0da14a5b695-kube-api-access-btp2w\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.070220 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.070210 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-sys\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.170857 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170808 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-proc\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.170857 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170860 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-podres\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171049 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170892 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btp2w\" (UniqueName: \"kubernetes.io/projected/dc21a37b-49a7-46aa-9201-d0da14a5b695-kube-api-access-btp2w\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171049 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170919 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-sys\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171049 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170953 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-lib-modules\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171049 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.170948 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-proc\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171175 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.171047 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-sys\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171175 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.171074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-podres\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.171175 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.171111 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc21a37b-49a7-46aa-9201-d0da14a5b695-lib-modules\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.178681 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.178662 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btp2w\" (UniqueName: \"kubernetes.io/projected/dc21a37b-49a7-46aa-9201-d0da14a5b695-kube-api-access-btp2w\") pod \"perf-node-gather-daemonset-w5r9w\" (UID: \"dc21a37b-49a7-46aa-9201-d0da14a5b695\") " pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.190797 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.190775 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-k7p5m_72e0e1ba-b5a2-414d-a3ca-c666c8f7ba4b/volume-data-source-validator/0.log" Jul 29 07:51:41.291489 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.291396 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.423653 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.423624 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w"] Jul 29 07:51:41.426191 ip-10-0-137-121 kubenswrapper[2583]: W0729 07:51:41.426160 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc21a37b_49a7_46aa_9201_d0da14a5b695.slice/crio-5f725b8929d11f728d67e662f51606bbff60facbee82367a4859b956a829ef16 WatchSource:0}: Error finding container 5f725b8929d11f728d67e662f51606bbff60facbee82367a4859b956a829ef16: Status 404 returned error can't find the container with id 5f725b8929d11f728d67e662f51606bbff60facbee82367a4859b956a829ef16 Jul 29 07:51:41.706674 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.706633 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" event={"ID":"dc21a37b-49a7-46aa-9201-d0da14a5b695","Type":"ContainerStarted","Data":"081927911ce4f39c6c09d750cbcfce79d8bd3a7213c34a431800c89b3c184771"} Jul 29 07:51:41.706852 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.706692 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" event={"ID":"dc21a37b-49a7-46aa-9201-d0da14a5b695","Type":"ContainerStarted","Data":"5f725b8929d11f728d67e662f51606bbff60facbee82367a4859b956a829ef16"} Jul 29 07:51:41.706852 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.706746 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:41.722792 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:41.722740 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" podStartSLOduration=1.722724535 podStartE2EDuration="1.722724535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 07:51:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 07:51:41.722156484 +0000 UTC m=+547.027271326" watchObservedRunningTime="2026-07-29 07:51:41.722724535 +0000 UTC m=+547.027839362" Jul 29 07:51:42.026841 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:42.026815 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nztc4_9c31fe19-ca22-41fe-a792-cc215e995f33/dns/0.log" Jul 29 07:51:42.048097 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:42.048073 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nztc4_9c31fe19-ca22-41fe-a792-cc215e995f33/kube-rbac-proxy/0.log" Jul 29 07:51:42.151453 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:42.151422 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbj2c_538b147a-27aa-47c5-bfaf-2795d513fa29/dns-node-resolver/0.log" Jul 29 07:51:42.637546 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:42.637519 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pxs5z_b24b3083-e417-412b-8217-91dd2d36f4ae/node-ca/0.log" Jul 29 07:51:43.371801 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:43.371761 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7b46454f75-rtnrd_1be2b4b5-0382-4d71-8f94-7d845678a827/router/0.log" Jul 29 07:51:43.690613 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:43.690536 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4cpfl_d43ea3bb-3484-416c-b138-7e0fe1a19a80/serve-healthcheck-canary/0.log" Jul 29 07:51:44.079877 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:44.079838 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-x8tsg_e7571a46-e8cd-450b-88ad-befabaa61213/insights-operator/1.log" Jul 29 07:51:44.086687 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:44.086664 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-x8tsg_e7571a46-e8cd-450b-88ad-befabaa61213/insights-operator/0.log" Jul 29 07:51:44.175764 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:44.175736 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9457_f7e08619-a170-4d5b-831e-fada8f3e32e6/kube-rbac-proxy/0.log" Jul 29 07:51:44.194590 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:44.194559 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9457_f7e08619-a170-4d5b-831e-fada8f3e32e6/exporter/0.log" Jul 29 07:51:44.213270 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:44.213244 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-f9457_f7e08619-a170-4d5b-831e-fada8f3e32e6/extractor/0.log" Jul 29 07:51:47.722041 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:47.721985 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5kjlb/perf-node-gather-daemonset-w5r9w" Jul 29 07:51:49.334666 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:49.334638 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx_620072be-215b-429c-9a33-a493eef4007f/kube-storage-version-migrator-operator/1.log" Jul 29 07:51:49.335461 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:49.335439 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-f7qkx_620072be-215b-429c-9a33-a493eef4007f/kube-storage-version-migrator-operator/0.log" Jul 29 07:51:50.367348 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.367267 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5dsrt_bcd906c2-9d4e-4344-a02c-7531d5d929ed/kube-multus/0.log" Jul 29 07:51:50.392335 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.392306 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/kube-multus-additional-cni-plugins/0.log" Jul 29 07:51:50.413401 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.413378 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/egress-router-binary-copy/0.log" Jul 29 07:51:50.433817 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.433790 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/cni-plugins/0.log" Jul 29 07:51:50.455195 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.455169 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/bond-cni-plugin/0.log" Jul 29 07:51:50.476736 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.476322 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/routeoverride-cni/0.log" Jul 29 07:51:50.497359 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.497338 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/whereabouts-cni-bincopy/0.log" Jul 29 07:51:50.519671 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.519647 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5ftxh_20405ff3-1221-47f5-a451-06bf081e038c/whereabouts-cni/0.log" Jul 29 07:51:50.879600 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.879572 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4bd2w_e8c61488-8296-4e7d-a73f-3e756f469c10/network-metrics-daemon/0.log" Jul 29 07:51:50.941403 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:50.941327 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4bd2w_e8c61488-8296-4e7d-a73f-3e756f469c10/kube-rbac-proxy/0.log" Jul 29 07:51:52.043560 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.043531 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/ovn-controller/0.log" Jul 29 07:51:52.062121 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.062085 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/ovn-acl-logging/0.log" Jul 29 07:51:52.084782 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.084758 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/kube-rbac-proxy-node/0.log" Jul 29 07:51:52.107314 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.107290 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/kube-rbac-proxy-ovn-metrics/0.log" Jul 29 07:51:52.127898 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.127870 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/northd/0.log" Jul 29 07:51:52.149621 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.149553 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/nbdb/0.log" Jul 29 07:51:52.171783 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.171752 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/sbdb/0.log" Jul 29 07:51:52.208796 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:52.208768 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-tf55x_a643efd7-ac92-4543-b6c7-044f07fec66c/ovnkube-controller/0.log" Jul 29 07:51:53.369343 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:53.369314 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-g5b9c_b676ff6a-666d-4afc-9811-2183be83336f/check-endpoints/0.log" Jul 29 07:51:53.435143 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:53.435114 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-qcj84_cabbe9eb-1109-4ef1-a720-07c152da1d00/network-check-target-container/0.log" Jul 29 07:51:54.362472 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:54.362437 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-vw24z_a1e7b802-f393-494f-a9f9-7f8098b74ef4/iptables-alerter/0.log" Jul 29 07:51:54.998673 ip-10-0-137-121 kubenswrapper[2583]: I0729 07:51:54.998647 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-j7bx4_b2316f24-a4e7-4711-8627-fa30e6a38a97/tuned/0.log"